Follow the below mentioned steps to update all nuget packages in solution in VSCode
Download the following extension: NuGet Package Manager GUI
Open command window with Command + Shift + P (MAC) or Ctrl + Shift + P (Windows)
Search for Nuget and select Nuget Package Manager GUI

Hit Update All Packages to update all the nuget packages in your solution.
