WordPress uses widgets for the content displayed in the sidebar. To change your widgets open you dashboard and go to Appearance > Widgets. From here you can drag & drop to add, remove or reorder your widgets as well as use the individual widget options to customize the look of your sidebar.

Based on your theme, you may also be able to find more sidebar customization options under Appearance > Customize > Sidebar for colors, sidebar widths, etc.