There are two pages you must read about this:
- The Best Free Open Source Software for Windows by Infoworld
- The Simple List of Best Free Open Source Software for Windows by opensourcewindows.org
Small business owners can reduce software costs by using these open source software. My favorite ones are Paint.Net, PDFcreator, Filezilla and 7z.