The best time to go is about 4pm and stay for several hours. Go with a guide who knows his stuff. It’s on a very big site, with lots going on and each temple is different. There are also people camping by the river and doing pujas in and by it etc. Many shades of different religions. Parades, weddings, dances, noisy music, a market……