All Systems Operational

About This Site

This status page lists the status of the core services directly within Ingresso's control: our API and our white label websites.

We do not list the status of the backend systems that we connect to, however when there is a problem with a backend system we receive an automated alert and then advise them of the issue.

API Operational
90 days ago
99.98 % uptime
Today
White label websites Operational
90 days ago
100.0 % uptime
Today
Supplier ticketing systems Operational
Reporting ? Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage
Past Incidents
Dec 11, 2019

No incidents reported today.

Dec 10, 2019

No incidents reported.

Dec 9, 2019
Resolved - This incident has now been resolved, and we will prepare a postmortem summary in the week ahead.

In short, we noticed some problems with the primary database yesterday evening causing an increase in API latency and transaction processing stopping. We began the recovery process within 5 minutes of the first notice, and in the process of recovering from it, inadvertently removed the disk storage for the primary database master. As a result, transaction processing was stopped for another minute while the system failed over to the backup master and a data recovery snapshot was taken.

We have recovered the data from the primary database from the backups and the database replication logs, and believe that no transactional data is missing, but during that time the reporting and transaction summary information for the affected transactions would have been unavailable, and any automated reports sent would have been out-of-date.

All systems are operating normally once more and the data should be available, and Ingresso would like to apologise to our partners for the impact of this incident.
Dec 9, 10:20 GMT
Monitoring - We have identified and fixed main source of the problem, we are currently monitoring API functionality to verify that all operations are back to normal.
Dec 8, 18:32 GMT
Identified - We have identified issue with our internal API, all connected distributors might experience intermittent problems with data retrieval and transaction processing. We are investigating the issue and working on a resolution
Dec 8, 17:48 GMT
Dec 7, 2019

No incidents reported.

Dec 6, 2019
Resolved - The Nederlander system has returned to good form.
Dec 6, 20:39 GMT
Identified - We're seeing an increased rate of errors and general API slowness on the Nederlander backend, which might mean customers may have problems trying to book.

The list of affected events is below. We have raised this issue with the system provider support team and are awaiting an investigation.

Y2MA Irving Berlin's White Christmas
10JNG The Prince of Egypt
43P2 TINA - The Tina Turner Musical
JYXW TINA - The Tina Turner Musical & 2 Course Pre Theatre Dinner @ Hawksmoor (Seven Dials)
VVFW TINA - The Tina Turner Musical + 2 Course Pre Theatre Meal @ Balthazar
43P5 TINA - The Tina Turner Musical + 2 Course Pre Theatre Meal @ Ivy Market Grill
43P6 TINA - The Tina Turner Musical + Post Theatre Meal @ The Ivy
Dec 6, 13:21 GMT
Dec 5, 2019
Resolved - The API is now responding as expected
Dec 5, 10:22 GMT
Identified - The TicketZone API has become unavailable and all calls are failing

We have raised this issue with TicketZone support and are waiting to hear back.
The list of affected events is below:

"event_id" "long_event_desc"
"Z3KY" "Disney On Ice Celebrates 100 Years Of Magic (London O2)"
"16NEE" "Disney On Ice presents Magical Ice Festival (Birmingham)"
"16NDU" "Disney On Ice presents Magical Ice Festival (Cardiff)"
"16P5A" "Disney On Ice presents Magical Ice Festival (Glasgow)"
"16P56" "Disney On Ice presents Magical Ice Festival (Leeds)"
"16NCC" "Disney On Ice presents Magical Ice Festival (Liverpool)"
"16NCE" "Disney On Ice presents Magical Ice Festival (Wembley)"
"16ENY" "Strictly Come Dancing The Live Tour (Aberdeen)"
"16BU6" "Strictly Come Dancing The Live Tour (Belfast)"
"16D5N" "Strictly Come Dancing The Live Tour (Birmingham)"
"169TD" "Strictly Come Dancing The Live Tour (Glasgow)"
"16A2D" "Strictly Come Dancing The Live Tour (Leeds)"
"16D62" "Strictly Come Dancing The Live Tour (London)"
"169T3" "Strictly Come Dancing The Live Tour (Manchester)"
"16A25" "Strictly Come Dancing The Live Tour (Nottingham)"
Dec 5, 09:55 GMT
Dec 4, 2019
Completed - The scheduled maintenance has been completed.
Dec 4, 09:00 GMT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dec 4, 08:00 GMT
Scheduled - The Crystal Maze and Kidzania supplier systems will be offline between 8:00 and 9:00 am UTC, Wednesday 4th December 2019 for scheduled maintenance.

Start: 2019-12-04T08:00:00Z
End: 2019-12-04T09:00:00Z

This means the following events will be offline:
event_id event_desc
14DFC KidZania London
NV9Z The Crystal Maze LIVE Experience (West End)
NVA1 The Crystal Maze LIVE Experience London West End
JVP8 The Crystal Maze LIVE Experience Manchester
NJ2E The Crystal Maze LIVE Experience Manchester
Dec 2, 15:09 GMT
Dec 3, 2019

No incidents reported.

Dec 2, 2019

No incidents reported.

Dec 1, 2019

No incidents reported.

Nov 30, 2019

No incidents reported.

Nov 29, 2019
Resolved - We suffered partial degradation on our white label website service between 28th November 2:00 pm and 29th November 11:30 am UK time. This affected a number of pages on white label websites that have Google Analytics/Tag Manager set up. This was caused by a defect in the configuration settings that load the GTM container to the page.

Analytics and GTM services are now back up. We are continuing a follow up investigation to ascertain which pages and partners have been affected. We apologise for the impact of this outage.
Nov 29, 11:00 GMT
Nov 28, 2019

No incidents reported.

Nov 27, 2019

No incidents reported.