Having pretty much settled into my new dwelling place in North Carolina, I quickly learned that heating a house (versus cooling, as was my primary utility expense in Florida) is NOT an inexpensive thing! The major choices include heat pump (by far the most efficient), coal, oil, LP or natural gas, kerosene and of course, electric heaters.
Some people have wood-burning stoves and fireplaces but those do require a lot of maintenance and attention. I love the aroma of a wood-burning fire!