[11:30 AM EST] – Stats processing is currently paused as we are performing some maintenance on our stats system. We’ll post further updates as the work progresses.
[2 PM EST] – Stats processing is running again now and we expect it to catch up later this evening.
We’ll be performing maintenance on our database systems at 2PM EST today. We expect this window to be very short but to avoid any issues we will be putting the system into maintenance mode during this time.
[2PM EST] – The system is now in maintenance mode. We’ll post an update when the work has been completed.
[2:10PM EST] – This maintenance has been completed and the system is now running normally again. Thanks for your patience and we apologize for the short notice.
Our team has located and is isolating issues regarding publishing of new content and accessing of the Libsyn dashboard. These issues were caused by a severe system delay on our back end. As these issues would cause errors in publishing of new content, we’ve enacted our maintenance mode to prevent errored posts while we work to correct the issue. Logins to the dashboard are currently, also, unavailable.
It is important to note that all content delivery is still functioning normally. This only affects publishing of new content.
All additional details will be updated on this post as they come in. We thank you for your patience.
Update 10:15am Eastern: The system has been pulled out of maintenance mode. However, stats processing is still temporarily disabled. Please note, stats are not lost during this time, they simply are paused for processing and delivery. Additional details will be posted as they become available.
Update 10:46am Eastern: Stats processing has been re-enabled, allowing download numbers to be processed and delivered. Please allow some time for processing and delivery to catch up, you may notice a delay in numbers appearing in your stats during this time.
[6PM EST] – Our stats processing is currently running slower than normal and is several hours behind at this time. We’re investigating the cause and will work towards a solution as quickly as possible.
[10PM EST] – We believe the stats processing speed has stabilized now and is running between 2-3 hours behind. We’re planning to roll out some changes tomorrow morning to help get it running at it’s normal speed again. We’ll post another update at that time. We appreciate your patience.
[January 10, 10AM EST] – We have rolled out a change this morning and are seeing stats processing times return to normal. It will take several hours for it to catch up completely and we’ll post another update at that time.
[January 10, 3:30PM EST] – Stats processing has fully caught up and continues to run as it’s normal speed.
[9:30 AM EST] – This morning we discovered that one of our stats processing jobs became stuck ~9 hours ago and failed to restart correctly. We have restarted the process and confirmed that stats processing is running normally again. We expect the stats processing to catch up over the next 4-5 hours. We’ll post an update when the processing is fully caught up again.
[4:45 PM EST] – Stats processing is now fully caught up and continues to work normally.
One of the network providers our data center uses is having issues on their network within the UK and elsewhere in Europe this morning. We’ve had our data center disable that provider for the time being. This should resolve any connectivity issues users were having. If you are still having troubles connecting to our services please email support.
It has come to our attention that there are issues and latency for subscribers to any RSS feed (Libsyn and non-Libsyn hosted) in the iTunes store. This can cause delays in accessing content for new subscribers as well as obtaining new posts from existing subscribers.
We have reached out to iTunes and are currently waiting a response. We will update this post with new information as it comes across.
UPDATE 10/4/2016 9:13am: iTunes is aware of the issue and are working to resolve the latency issues. The issue is still ongoing and intermittent.
UPDATE 10/5/2016 12:06pm: iTunes has continued to investigate intermittent delays, however, the issue seems to have alleviated at this time. If you continue to experience issues subscribing to a show, please contact support@libsyn.com.
[8AM EST] – Our FTP server is currently experiencing connectivity issues and will be unavailable for most users. We’re working with our provider where the FTP server is hosted and will post an update when we hear back from them.
[11AM EST] – The network switch connected to our cabinet failed and has been replaced, the FTP server is back up and running normally again now.
[11:30AM EST] – We’re doing some maintenance on our stats system today. Stats processing is currently paused we’ll update this post as our work progresses.
[2 PM EST] – Stats processing is running again now, we’ll update this post once it’s fully caught up.
[4 PM EST] – Stats processing is fully caught up at this time. Today’s maintenance brought additional hardware online to our stats processing to improve performance and support our continued growth. Thanks for your patience.
[11AM EST] – We’re seeing uploads be slow and sometimes fail to one of our cloud storage providers. We’ve opened a ticket with them and they are aware of the problem and have engineers working on it. You’ll see this as the ‘processing’ step of uploads takes longer than normal and may fail. We’ll update this post when we get an update from our provider.
[12:45PM EST] – The cloud storage provider is still working on the issue but at this time they haven’t provided any ETA on when it will be resolved.
[4PM EST] – Since our primary cloud storage provider is still having issues, we’ve removed them from our upload process at this time and our relying on our secondary cloud storage partner. We’ve verified that uploads are functioning normally again with this change in place.
