Details surrounding Prince Harry’s recent trip to Canada are being disputed by Buckingham Palace, despite pushback from the Duke of Sussex’s team.

Harry, 41, kicked off a trip centered around events commemorating Remembrance Day in Toronto earlier this month. (Remembrance Day is the British equivalent of Veterans Day in the U.S. and is also observed annually on Nov. 11.)

Now, PEOPLE understands that Harry’s trip to Canada caught palace aides by surprise, despite the Duke of Sussex’s team saying it had informed them.

When Harry’s team announced the trip on Nov. 3 — just as Prince William touched down in Rio for his Earthshot Prize week — they indicated that royal communications staff had been informed in advance.

However, palace aides say they were caught off guard by the announcement.

Prince Harry during his Remembrance Day trip to Canada on Nov. 6.Nathan Denette/The Canadian Press via AP

Earlier this year, Harry reportedly offered to share his official schedule with the royal family, in what appeared to be an olive-branch gesture amid continued tensions.

The plan would provide transparency and help avoid conflicts between Harry and Meghan Markle’s public outings and the British royal family’s engagements, and therefore claims of trying to overshadow each other.

Prince Harry and Prince William’s relationship is strained amid a rift that became public when Harry and Meghan, 44, stepped back from their royal roles in the U.K. in 2020 and moved to California. The divide deepened after the couple’s 2021 interview with Oprah Winfrey, Netflix docuseries and Harry’s bestselling book — each delivering criticism of the royal family.

Harry had a groundbreaking meeting with the royal brothers’ father, King Charles, in September, spending time together in person for the first time in 19 months. A former royal aide told PEOPLE the reunion was “a massive step in the right direction.”

Prince Harry in Canada on Nov. 6, Prince William in Brazil on Nov. 5.Eduardo Lima/The Canadian Press via AP; Aaron Chown-Pool/Getty

The mixed messaging between Prince Harry and the palace comes after the Duke of Sussex and Meghan faced controversy surrounding their attendance at Kris Jenner’s James Bond-themed 70th birthday party.

A day after the star-studded event, fans noticed that Harry and Meghan had been removed from a carousel of photos posted on Jenner and Kim Kardashian’s Instagram accounts.

PEOPLE understood that the photos were deleted because the duo had checked “no” on a photo consent form, but a source close to the event later said that wasn’t the case, stating, “There were no consent forms.”

Harry and Meghan attended the lavish celebration, held at Jeff Bezos and Lauren Sánchez Bezos’ Beverly Hills mansion, alongside other stars including Mariah Carey, Paris Hilton, Vin Diesel and Adele.

A source previously told PEOPLE that Meghan and Harry “arrived hand-in-hand and looked very happy” at the party.