between abingdon and marlow there are very few riverside pubs and those that are I found to be silly expensive,but I still enjoyed it,hardly anyone about just me and my new mrs !!
I would go for the broads plenty more pubs en route,plenty more boatyards so a bit cheaper and take a driving day trip to hampton court at another time
Off the top of my head
Nags Head - Abingdon
The Plough - Long Whittenham
The Barley Mow - Clifton Hampden
Shillingford Bridge Hotel (moorings are pricey) sometimes there are a few free ones just upstream
The Boat House - Wallingford
The Swan - Pangbourne
George & Dragon - Wargrave
Plenty more pubs within a short walk on that stretch
I admit it's not as easy to do a pub for lunch and another for dinner as it is on the Broads
Ahh then, if you can reasonably sleep the odd night on your boat, you could do as we often do, and make a trip which combines nights on board, where possible with facilities nearby, camping and perhaps splash out on a luxurious night in a nice hotel.
A few random places we have stayed when doing this
Cookham Lock - excellent camping in a small site at the lock, with excellent showers.
Hurley - large well equipped campsite or (more secluded) pretty small site on lock island.
Oakley Court Hotel. Far from cheap but very very nice (especially the grounds).
Monkey Island Hotel. Quirky hotel, fascinating location, kids will love the peacocks.
Higginson Park Marlow. (Sleep onboad) Public mooring - mooring fee entitles you to use showers and loos at leisure centre. Superb Playground in the park, cafes and pubs galore nearby.
Laleham Camp site. Big site, can get full (there are not all that many campsites in SW London) so need to book. It's just across the road from the River. Laleham itself is a nice location, and this a convenient stop between Windsor and Teddington.
Windsor - moorings around Deadwater Ait. (Sleep onboard) Very popular and can be difficult to find a space, but note that again here the mooring fee gets you access to leisure centre facilities, including IIRC a discounted swim. Alternatively we have sometimes stayed at the Travelodge in Windsor.
The EA advise that in general wild camping beside the towpath (AKA Thames Path National Trail), is not allowed, BUT our experience is that a small discretely coloured tent near a moored boat is more often tolerated than not.