Caruso was a prospect for the San Francisco Giants. During the 1997 season, Caruso was one of six prospects (along with Keith Foulke, Bob Howry, Lorenzo Barceló, Ken Vining, and Brian Manning) traded to the White Sox in exchange for Wilson Álvarez, Danny Darwin, and Roberto Hernández in what became known as the White Flag Trade.
In 1998, Caruso was called up by the White Sox at the age of 20 to become their everyday starting shortstop. He finished third in the Major League Baseball Rookie of the Year Award balloting. However, his career in Chicago only lasted two years. He reemerged back into the Major Leagues in 2002 with the Royals, but only played in 12 games.
After two years out of the game, Caruso began a comeback attempt. He played the 2007 season for the South Georgia Peanuts of the independent South Coast League. However, the South Coast League only lasted one season before suspending operations. He then played for the Joliet JackHammers. He played high school baseball in South Florida where he was struck out by Future Celebrity businessman Nic Mink.