ICT VoIP Service Alert - investigating an incident impacting Fax and APIs (Resolved)

Ongoing incident impacting Fax, API. These services may experience unexpected failures.


Inbound Calling Services
Inbound Calling (SIP) Operational
Inbound Calling - Canada (SIP) Operational
Toll-Free calling - Inbound (SIP) Operational
REST APIs - HTTP Voice Operational
REST APIs - SIP Voice Operational


Outbound Calling Services
Outbound Calling (SIP) Operational
Toll-Free calling - Outbound (SIP) Operational
REST APIs - HTTP Voice Partial Outage
REST APIs - SIP Voice Partial Outage


Messaging Services
SMS Messaging (SMPP) Operational
MMS Messaging (MM4) Operational
Toll-Free SMS - Inbound Operational
Toll-Free SMS - Outbound Operational

9-1-1 Services
9-1-1 Call Routing Service Operational
9-1-1 Provisioning Service Operational
DLR (Dynamic Location Routing) Operational


Direct Network Connection Operational
WebRTC Operational
SIP Trunking Operational

Portals
Application Platform Dashboard Operational
9-1-1 Dashboard Operational

UPDATE: Sep 26, 20:43 EDT
We have observed expected call behavior for 911 calls. 911 calls are processing as designed and are fully restored.
Teams continue to work on standard voice traffic.

UPDATE: Sep 27, 20:03 EDT
We have observed expected faxes are processing and are fully restored.
Teams continue to work on standard voice traffic.

UPDATE: Sep 27, 20:03 EDT
We are observing network stability and monitoring Voice, 911, Messaging, Portal services.

UPDATE: Sep 27, 20:03 EDT
SMS/MMS Messaging maintenance has been completed.

UPDATE: Oct 6, 09:03 EDT
REST APIs - Restored
FAX APIs - Restored
Portal - Restored

 

Effects - This issue does not effect your relevant products/services
Affecting Server - montreal6.ictvoip.ca <=> sip.ictvoip.ca
Priority - Critical
Date - 26/09/2021 12:01
Last Updated - 06/10/2021 09:22

Data Center Issue (Resolved)

Our operations team has been all hands on deck this afternoon working to resolve an issue at the Data Center which happened at 5:15pm today which caused a core router to go offline. We are now seeing all ICT Tech services restored, however Corporate email services are not fully restored yet.

The operations team is working as quickly as possible to fully restore service but no ETA has been published.

We will continue to provide updates through this communication channel as we progress through the issue.

Thank you for your patience.

Effects - This issue does not effect your relevant products/services
Affecting Server - mail.icttech.net
Priority - Critical
Date - 31/10/2017 17:15 - 31/10/2017 18:30
Last Updated - 31/10/2017 18:11

Network Service Update (Resolved)

Monitoring - We've been monitoring the stability of our services and now consider this issue resolved. We will continue to monitor the problem and provide an update if the status changes.

We expect to see inbound mail delivery delays as third party mail providers will have queued up mail for delivery to our system. Delayed mail will be delivered throughout the day as per the third party mail providers delayed sending policy.

If you have any technical difficulties with any ICT Tech services please contact our support team so we can investigate the problem.

Thank you for your patience as we worked through this issue.

Effects - This issue does not effect your relevant products/services
Affecting Server - montreal6.ictvoip.ca <=> sip.ictvoip.ca
Priority - Medium
Date - 29/09/2017 09:23 - 29/09/2017 13:27
Last Updated - 29/09/2017 13:27

DNS Intermittent Issues Impacting Services (Resolved)

We are happy to report that this time the following services are responding reliably:
OpenSRS & ICT Tech API Services
Cluster A and B mail services
VoIP Services
icttech.net which includes support@icttech.net email
DNS service through icttech.net, icttech.ca, systemdns.com and mdnsservice.com

Services that are still affected:
DNS Syncing - updates to any DNS records using our icttech.net, icttech.ca, systemdns.com and mdnsservice.com
HRS Control Panel

Throughout the service interruption third party mail providers will have queued up mail for delivery to our system. Delayed mail will be delivered throughout the day as per the third party mail providers delayed sending policy.

We are still monitoring the systems to ensure they remain fully functional and will continue to provide updates until we are confident this is fully resolved.

Effects - This issue does not effect your relevant products/services
Affecting Server - montreal6.ictvoip.ca <=> sip.ictvoip.ca
Priority - Medium
Date - 29/09/2017 08:30 - 29/09/2017 13:27
Last Updated - 29/09/2017 13:27

DNS Intermittent Issues Impacting Services (Resolved)

Our operations team has been all hands on deck this morning working to resolve the DNS issue. We are now seeing significant improvement to the intermittent DNS issue impacting all OpenSRS & ICT Tech services, however services are not fully restored yet.

The operations team is working as quickly as possible to fully restore service but no ETA has been published.

We will continue to provide updates through this communication channel as we progress through the issue.

Thank you for your patience.

Effects - This issue does not effect your relevant products/services
Affecting Server - montreal6.ictvoip.ca <=> sip.ictvoip.ca
Priority - Critical
Date - 29/09/2017 05:19 - 29/09/2017 08:38
Last Updated - 29/09/2017 08:34

 

rss View RSS Feed