Can I display contact information on a public page?
Yes. Profiles basically allow you to: create/edit/list/search a group of contacts and only display certain fields.
One of the main uses of CiviCRM Profiles is to create searchable directories/listings of some or all contacts for "the public". Check out Profiles Admin for more detail.