Ann Koger has overcome many barriers to make her name in the tennis field. She credits her mother Myrtle’s love of tennis for her own interest in the sport. Koger practiced at Druid Hill Park as a child. In 1962, at the age of twelve, she won her first tournament. Koger was eager to go further, but Black players were heavily discriminated against in the 1960s. They were barred from playing at many clubs. Nevertheless, Koger was a top-ranked junior player in the USLTA. In 1968 she won the ATA National Woman’s Doubles Championship.

While a student athlete at Morgan State University, she and Bonnie Logan were the only two female players on the men’s tennis team from 1969 to 1972. Not only were Koger and Logan the first Black women to represent a historically Black university in a collegiate tournament, but, in 1973, they made history by becoming the first Black women to play in the Virginia Slims Tennis Circuit. Koger recalls this experience as “a great opportunity, but a lonely opportunity because there weren't more like me once I started moving in the national spotlight.”

She continued to compete professionally until 1977. In 1981 she became the women’s tennis coach at Haverford College, serving in that position for 35 years until retiring in 2016. Koger has officiated other sports, such as basketball, and in 1985 became the first woman to officiate an NCAA Division I men’s game. That same year she was the co-director of the NCAA Division III Women’s Tennis Championships and served as the first Vice President of the American Tennis Association. In 2015, she served as the coach for the United States Tennis Association (USTA) Middle States Girls’ 18 National Team Championship. She also was a member of the ITA Small College Operating Committee and a second-term member of the ITA Board of Directors.

Koger has continued to champion the cause of social justice throughout her life. While the women’s tennis coach at Haverford in 2000, she protested the use of the Confederate Flag by cancelling the team’s training in South Carolina.

Koger has been recognized with multiple awards and certifications, including the National Community Service Award from the USTA in 1996. She has been selected as a member of the both the Black Tennis Hall of Fame Class of 2010 and the USTA Middle States Hall of Fame Class of 2010. In 2016, Koger was honored by the Professional Tennis Registry (PTR) as the Coach of the Year.