Essential supplies for getting started:
pile of paper/notepad
pile of file folders
place to put file folders
pen(s)

I really wouldn't recommend buying anything else until you have some idea how to structure your system: are contexts important, or not? Do you have lots of complex projects, or not? Is your day highly scheduled, or not? Are you mostly mobile, or mostly office-based?

Katherine