The Caltech Pedestrian Dataset consists of approximately 10 hours of 640x480 30Hz video taken from a vehicle driving through regular traffic in an urban environment.
http://www.vision.caltech.edu/Image_Datasets/CaltechPedestrians/
The Freiburg RGB-D People dataset contains 3000+ RGB-D frames acquired in a university hall from three vertically mounted Kinect sensors.
http://www2.informatik.uni-freiburg.de/~spinello/RGBD-dataset.html
The PIROPO database (People in Indoor ROoms with Perspective and Omnidirectional cameras) comprises multiple sequences recorded in two different indoor rooms, using both omnidirectional and perspective cameras.
https://sites.google.com/site/piropodatabase/
The INRIA Person dataset is a dataset of images of persons used for pedestrian detection. It consists of 614 person detections for training and 288 for testing.
https://dbcollection.readthedocs.io/en/latest/datasets/inria_ped.html