With excel, you have a separate column with the Standard deviations in
it. Select the chart and double click on the data series. Select the "y
error bars" tab.
Check the box marked "custom" with a + sign in it.
Sweep the cursor down the column with the standard deviations in it, and
click OK. This should give you the error bars as you described them.