I used to shoot with 35mm. Had an old school Minolta Maxxum 7000.
Whether digital or film, cost should not be a consideration when first starting up. Use anything you have, and get some books. The basics, tricks and techniques are more important to master than the type of equipment you have, and you'll get a good feel for whether you'll want to invest more money in the future.
If you're at that point already, then consider buying used equipment and you'll save a lot. Nothing wrong with it, especially with things like filters and lenses, hoods, remotes, flash, etc. One thing beginners often overlook is the importance of a good, strong & solid tripod . . . don't go for those cheaper lightweight models, you'll regret it.
Oh, and if you don't already have Photoshop, you're gonna want it.