French explorer Jean-Baptiste Benard de la Harpe is the one credited with naming Little Rock, and it was named for an outcropping of rock along the Arkansas River. Explorers and early settlers called it "Le Petite Roche" (the Little Rock) to distinguish it from the big rock upstream. Today, you can see a piece of the Little Rock at the north end of Rock Street near the History Pavilion in Riverfront Park.
Walking in Riverfront Park, La Petit Roche Plaza is between the Amphitheater and the Junction Bridge in a fence.
Riverfront Park is filled with fun history facts about early settlers. The 11 block park also has walking trails and some glimpses of the Arkansas River. It's worth a trip if you're in town. Map to the park.