Boswell Stephen of Ware Hertford England

I'm after details of the Boswell Family from Ware, Hertford, England. I have Stephen BOSWELL b. 1824, mother named Mary. No father/husband listed on the 1841 Census. Stephen married Sarah, also of Ware. I believe her maiden name may have been Brooks/Brookes. One possible connection is that on the night of the 1851 census they were listed as "visitors". The family in the house next door were Brooks. By 1861 Stephen and Sarah were in Edmonton, London. Love to hear from anyone with a connection.