Taylor Swift and Travis Kelce Party Until 4 a.m. Following His Eras Tour Stage Debut in London

Taylor Swift and Travis Kelce are celebrating his Eras Tour stage debut!

On Sunday, June 23, Kelce, 34, surprised fans by taking to the stage alongside Swift, also 34, for her “I Can Do It With a Broken Heart” outfit change during her third show at London’s Wembley Stadium.

The power couple celebrated by heading to celebrity hotspot Chiltern Firehouse and partying late into the night. The musician’s latest gig marks her final London date for now before she returns for five more shows at the venue from Aug. 15.

For the post-show outing, Swift wore a colorful crochet mini dress featuring long, slightly flared, sleeves. She added some extra height with a pair of yellow open-toe chunky heeled sandals and completed the vibrant look with a brown bag worn over her shoulder.

The “Love Story” hitmaker wore her hair in loose waves around her shoulders and added a touch of her signature red lipstick.

Meanwhile, Kelce opted for a casual chic look, donning a loose white shirt that he wore with matching pants and a blue bucket hat.

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!

The Kansas City Chiefs star’s ensemble was far more low-key than the one he wore on stage earlier in the evening. For his big appearance, Kelce dressed to the nines in a tuxedo and top hat, carrying Swift before setting her down gently on a red couch in the center of the stage.

The NFL star even did Swift’s faux touch-up as she changed outfits during the segment, dusting her face with powder.

Despite this being Kelce’s first time onstage, he’s attended multiple Eras Tour shows through the months since the duo first sparked dating rumors in September 2023.

The two confirmed their romance in October 2023 when they stepped out holding hands at a Saturday Night Live afterparty. Swift was later spotted at a handful of Kelce’s games, including the 2024 Super Bowl on Feb. 11.

Kelce’s onstage appearance came after he and Swift went Instagram official in the best way on Friday, June 21, as they posed for a selfie backstage at her first London show with Prince William,Prince George, 10, and Princess Charlotte, 9, on the royal heir’s 42nd birthday.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

Swift’s London dates attracted a star-studded crowd. On Friday, Salma Hayek, 57, was among the guests, with the actress sharing multiple photos on Instagram featuring Bridgerton star Nicola Coughlan, Stella McCartney, Leslie Mann and Queer Eye‘s Jonathan Van Ness.