Sure, Ørberg coupled with other books is fine enough. I do think his basic idea (a text that gets progressively more grammatically complex) is important and good, but not without exercises, grammatical elucidation, drills, etc.

Also, you're much better off reading The Hobbit in English. The Latin translation is known to be less than superb.