Thu, 17 November 2005 According to the folks at nanog: Cogent is experiencing 2 fiber cuts in the north/southeast-US. The locations are: Between Houston and Tampa (Southeast) Ticket #347277 Between Philidelpha and DC (Northeast) Ticket #347375 As a result we have seen about a 20-30% decrease in traffic. We will keep you updated as things develop. Category: announcements -- posted at: 12:55 PM Comments[1] |
Wed, 9 November 2005 We'll be bringing the main server down for a very short time, around 6:30am this morning to install a disk. This outage should last no longer than 2-3 minutes. Category: announcements -- posted at: 5:02 AM |
Sun, 6 November 2005 Around Midnight tonight we'll be doing a network test to check out our routers and our uplink to the internet. We noticed some potential problems earlier in the day and scheduled a test immediately to pre-empt any loss of service. Thinkgs might slow down for 10 minutes or so, then should go back to normal. Category: announcements -- posted at: 8:49 PM Comments[0] |
Thu, 3 November 2005 Okay here's the damage report:
It looks like around 10am eastern standard time, our domain libsyn.com ceased connecting to our site. We checked our system, at first we thought that the dns issues may have been related to the previous late night upgrades. We soon found that it had nothing to do with problems in our data center, and we contacted our Registrar to see what was happening. This registrar currently hosts libsyn.com, libsyn.org, libsin.com, liberatedsyndication.com, etc. An hour and a half later on the phone we were informed that it had to do with "core system problems" on their end. We were told to wait. We continued to look into possible dns disconnects with our system. Around, 2pm upon two additional phone calls, we were informed that our account was on hold due to a complaint regarding an invalid whois entry. Even though the first 4 people we talked to today didn't seem to have the information that we were being suspended, this is where we must take some responsibility for today. The notification emails that the whois information was invalid never reached us.
We then spent the rest of the day pushing on the registrar to accelerate reactivation of the domain. Things started coming back around 5:30pm today. The lessons have been learned, we are changing registrars. We appreciate all the patience that you guys have given us today. Category: announcements -- posted at: 8:28 PM Comments[9] |
Thu, 3 November 2005 Hey Guys, We are having a DNS issue that may be out of our hands. We have contacted our registrar who responded that we may be affected by issues with some of their "core servers" that announce the IP address for our domain. We are working to resolve this issue and will keep you guys updated.
http://libsyn.org will get you to the site right now, but unfortunately, that is not going to help your listeners that are having problems.
Category: announcements -- posted at: 1:13 PM Comments[4] |
Thu, 3 November 2005 Red letter day in libsyn history. To celebrate, we bought it a new switch and a couple more delivery nodes. I'm all out of being funny right now. Read the soundoff post if you want humor.
Thanks for sticking with us folks. We know it's been up a roller-coaster year. If we didn't love hearing your voices screaming our names (mostly) in pleasure and (sometimes) in pain, we wouldn't get out of bed in the morning. Now that we got people pushing video, we can't wait to see where soapy will turn up next! Category: announcements -- posted at: 4:51 AM Comments[0] |
Sat, 29 October 2005 Since we introduced the public RSS feed option and the ability to redirect your-username.libsyn.com/rss to that address, some of you have taken advantage of this feature to redirect your libsyn feed URL to your feedburner feed. This caused a slight problem, since feedburner gets your feed information by checking your libsyn feed (thus creating an infinite loop). We got together with the folks at feedburner to fix this problem as soon as we leanred of it. If anyone is still having problems with their feed, please drop an email to support. Thanks. Category: Bugs -- posted at: 5:42 PM Comments[3] |
Mon, 24 October 2005 Update: We had to deal with 2 major outages today as a result of todays disaster. The technical explanation for why the redundant power did not kick in was due to a faulty ATS switch within one of the UPS backups. When the power went out, the UPS's kicked in, in battery mode. Once the juice started to get low, one of the UPS's automatic transfer switches didn't cut over to generator power. The core routers for the datacenter were being serviced by that UPS. Everything was fixed early this afternoon and running off the generators for about 7 hours. Then, when the mains power came back on, the switch failed again this time in the other direction, switching back. The UPS system is being serviced. We are all learning a thing or two about seldom used emergency systems, and will be monitoring everything very closely.
We again apologize for the effects felt by this natural disaster. Thank you for your continued support
libsyn.com has been affected by Hurricane Wilma. Our datacenters are in florida, and apparently the power outage there brought us down. We are investigating as to why backup generators and other precautions did not prevent this outage. As soon as we know something we will let you know. We are sorry for the inconvenience, More updates on this coming. Category: announcements -- posted at: 1:14 PM Comments[3] |
Mon, 17 October 2005 A form of DOS attack hit our data center this evening around 8:50PM. Thankfully we have a very alert and responsive tech staff that reacted to the attack and has brought our network back online in less than half an hour. Category: announcements -- posted at: 8:39 PM Comments[0] |
Sat, 15 October 2005 Hey folks,
We've had some requests for automatic RSS feed redirecting, and we've gotten around to putting it in there. To make it work, you'll put the URL you want your feed redirected to in the "public rss feed" setting under basic settings. It's not active yet, though, because I wanted people with a setting in there already to know what was going to happen. With this setting active, we won't generate a libsyn rss feed anymore, it will just redirect username.libsyn.com/rss to the one set in your settings pane. I'm planning to make this active in about a week, but if you want to have it active sooner, email support, and we'll put you in there sooner. As always, with any questions, email support or post on the forum. Yours, - hoopes Category: Feature -- posted at: 5:47 PM Comments[1] |
Sun, 9 October 2005 Periodically, you may see one of the following messages upon publishing a post: Could not ping audio.weblogs.com: Can't call the script because the name "pingSuite" hasn't been defined. Server Responded: Can't find a sub-table named "weblogs". These messages are coming from the audio.weblogs ping server. The best thing to do if you get this error is to wait a few minutes, and then try manually pinging them at http://audio.weblogs.com/pingform.htmlIn some cases, you'll see that despite the warning, your ping actually has gone through. Category: general -- posted at: 10:00 PM Comments[1] |
Sun, 9 October 2005 From 10am until around 1PM today you may have experienced slow connections to libsyn and probably even some timeouts. The cause of the problem stemmed from the way we were previously handling the archive media network. When we started, the archive network was 6:1 smaller than the main media delivery network. As we have grown, the amount of data in the archives continues to grow so we have had to expand the number of nodes. The network logic, however, hadn't been scaled with the addition of more servers.
The main libsyn media delivery network has been greatly tweaked and enhanced to provide seamless data delivery in the event of hardware or software failure on any of the individual nodes. Currently serving over 2 million media files a week, or approx. 7 terrabytes of data, its been pretty good for the most part. Outside issues dealing with databases, general network outtages, and file uploading aside, the libsyn media delivery network has had a pretty good track record with download speeds usually topping anything we see from other media websites. This mornings issues have caused us to reevaluate the handling of the archive network and upgrade it to the level of robustness we have in place for the main media network. Category: Bugs -- posted at: 1:30 PM Comments[0] |
Fri, 7 October 2005 It looks like connections between cogent and level 3 are coming back up, as seen here: http://status.cogentco.com/ We are here monitoring everything, and working to keep things as smooth as possible. We'll keep you posted. Category: Bugs -- posted at: 4:54 PM Comments[0] |
Fri, 7 October 2005  We are trying desperately to get all caught up on email and support forum issues. If you email us, and don't hear back in the traditional amount of time, please give us a little bit more time to get everything caught up. We installed an email management system _right_ before 3 major events occurred. Nothing like baptism by fire I guess.. keeping tabs on the status of requests is easier, just making it work into our traditional workflows is taking a little time. No more excuses, we'll just keep chipping away
Dave M. circa 2005 not posing Category: announcements -- posted at: 4:39 AM Comments[3] |
Thu, 6 October 2005 It's a crap deal, two big internet service providers, cogent and level 3 are in a tiff. They are not talking to each other. I'm not trying to be funny, it's crappy whats going on. An email should have been sent out, it may have fallen into black whole that these providers have created. Bottom line, for those of you that can't reach libsyn send us your ip addresses. We are passing those off to our datacenter guy who is manually rerouting how our site gets to you. Also important, according to our charts your shows are being served to MOST of your audience. This apparently has never happened before. It's not just us either, parts of the internet can't get to other parts of the internet. Big companies being Big Jerks. I need coffee. below is better explanations by my more eloquent buddies. Here's the drafts: Marty put it like this: Hey everyone... libsyn is up and running and has been since the migration last Sunday night. What you're experiencing is the result of a corporate catfight between 2 major networks who facilitate large amounts of inter-connectivity across the net. Dave C said this: Dear libsyn customers- Sorry to invade your inbox with more email, however we wanted to let everyone know we are ontop of the current issue going on in Internet land. "This is history in the making" says our ISP. http://ask.slashdot.org/askslashdot/05/10/05/2247207.shtml We are working to get around this issue which mostly seems to be affecting TimeWarner Roadrunner users specifically by taking the IP addresses of the users being affected, looking at the IP block of their provider, and manually adjusting our BGP tables. If all that went right over your head, no problem. Bottom line: if you are having troubles connecting to libsyn.com, we are not offline. Please email support@libsyn.com with your IP address, and we will work our best to reroute the connection so you can get in. Category: Bugs -- posted at: 2:48 PM Comments[5] |
Wed, 5 October 2005 It seems many users of the Time Warner roadrunner internet service are having trouble reaching libsyn.com. It seems to be at the network level, there are connection problems and our ISP and techs are working to help solve the problem. Our network load shows that the majority of your audience is still receiving your podcasts and the issue seems bound to the Roadrunner customers. Category: announcements -- posted at: 9:04 PM Comments[2] |
Mon, 3 October 2005 For those of you who handle your own dns entries, you'll want to update the record for any domains pointed at libsyn.com. The new ip address is 38.100.193.69 Also for anyone having trouble logging into the libsyn FTP servers, this could be an issue with the DNS not being fully propagated. If you are having this problem, try using the IP address instead of ftp.libsyn.com to be sure your ftp client is trying to connect to the right server. Category: announcements -- posted at: 9:46 AM Comments[0] |
Sun, 2 October 2005 It was a bloody battle, but I think we came out on top. The migration of the main libsyn.com webserver to the new datacenter went off today without any impact to media file downloads. User login was disabled for longer than we would have liked and the forums were also disabled for a few hours this afternoon.
We are now waiting for the DNS change to propagate, so if you still see the site as having login disabled, it's just a matter of time until your local cache updates. We are pretty happy with the way things went today, took longer then we hoped, but the performance increase should be worth it Please report issues immediately to support@libsyn.com Category: announcements -- posted at: 6:49 PM Comments[1] |
Sun, 2 October 2005 Things got pushed back a little bit this morning due to an underestimate for the time to copy user log files. We are just about to truely start the switch. User logins and uploads will be temporatily disabled during the middle of the move. Media delivery should be maintained through the entire process, with the exception of a few spot down times.
next update when things are done and back to normal Category: announcements -- posted at: 1:41 PM Comments[2] |
Fri, 30 September 2005 Ladies, you will all get a chance to thank M personally and buy him a birthday drink at the podcast expo this november. Ok Marty, NOW GET BACK TO WORK!M. circa 1996 Category: announcements -- posted at: 1:14 PM Comments[1] |
Wed, 28 September 2005 We are playing a bit of catch-up on support emails. Today was another banner day for traffic- nearly 8TB (terra-bytes) and we are paddling harder than ever to keep everything running. This weekends upgrades are sorely needed.
We are doing our best to respond to every email as quickly as we can. Category: announcements -- posted at: 11:55 PM Comments[1] |
Tue, 27 September 2005 dear libsynners-
As part of our continuing effort to provide the best podcast delivery service, we are undergoing some major transitions and upgrades. During that upgrade period, which we intend to begin approx. 12:00 PM EST this Sunday 10/2/2005, you may experience some service disruption. Our game plan is to complete the transition with enough time to fully test the new setup with before the monday morning rush.
Once complete, the IP address of NS1.libsyn.com and NS2.libsyn.com may be changing. We will update http://support.libsyn.com with the updated IP addresses should we need to change them.
The intended results of this upgrade are faster page loads, decreased delay in media file download starts, decreased propagation delay from the time uploaded to full distribution across our delivery network, increased upload bandwidth to allow of fast file uploads, stronger faster and more reliable database access, and improved archive download speeds.
We have been experiencing more growing pains than we would have liked these past few weeks, and we can't say enough about how much we appreciate everyone sticking with us. Thanks to the support of all of you, we are able to offer our service. Your continued patience and understanding through these tremendous times of growth and change is always appreciated. Category: announcements -- posted at: 11:24 PM Comments[6] |
Tue, 27 September 2005 I just want to acknowledge the slowdowns, followed by a short period of downtime, we experienced this morning. From around 9:00-10:30am we saw a significant performance hit on the main server. For about 15 minutes of that time, the site was completely down. I apologize for your frustration- we take libsyn uptime very seriously and have admittedly struggled the past month to maintain consistency throughout our network.
The problem this morning was caused by a runaway media node that backed a lot of traffic up to the main server. I'll be implementing a threshold today to prevent this particular problem in the future. Category: Bugs -- posted at: 1:09 PM Comments[0] |
Wed, 21 September 2005 First want to say thank you to everyone for your patience. We had a serious bug which took us almost an entire day to recover from. Everything looked 100% up to the last minute, then we had another issue popup. That issue, causing the most recent downtime (last several hours), has been repaired, and the full data recovery from Sunday's issue has completed.
Please let us know immediately if there are any issues. We are setting up a virtual call center so libsynners can get us on the phone quickly in the event of serious problems. Until then, email support@libsyn.com first, then try one of us on skype, then as a last resort you can get my cell number from webmayhem.com. I personally want to commit to all of you that we are working on the issues that arise from serving this huge amount of data. I take responsibility for our recent performance flaws, and wish to make it right with each of you one at a time. Your satisfaction and enjoyment using libsyn is my priority. -Dave Chekan Category: general -- posted at: 9:24 AM Comments[1] |
Mon, 19 September 2005 Hey Guys,
Everything should be coming around very soon. It took well over twelve hours for the whole thing to normalize since the server downage yesterday. With podcasting there is never any slow of traffic, so there is no recoup time. Our email, was down so we are backed up on support emails, but we will get to everything. We are literally in the last stretch of getting to all systems go. We will let you guys know when we are 100% on here
as always.. talk is cheap.. we'll get things back on track.
Very sorry about the inconvenience. Category: Bugs -- posted at: 4:13 PM Comments[2] |
Sun, 18 September 2005 Update:
We are continuing to fight a battle to keep data moving through our network. You may experience some periods of media files being unavailable. All hands are aware of the situation and are working to repair the problems as quickly as possible.
As always, we appreciate your support and patience.
Our servers took a nosedive this evening and experienced some downtime. The issue was network related and somewhat out of our control. What is in our control is a more robust fallback which is what we are moving to in the very near future. We apologize for the inconvenience. Category: general -- posted at: 11:56 PM Comments[2] |
Sat, 10 September 2005 we have the new hot rod running stats, and the old pinto is being retired bluejack has been toiling away in the thrilling world of statistics aggregation and data mining and a bunch of other numbers crap spot checking has shown the data to be identical to the old stats, so hopefully you won't even notice this switch except for the fact that stats are updated much more often of course, you guys are the worlds best customers/people/friends/internetters, and i don't know where i was going with this sentence, but it must be because i am giddy that BJ has chipped this monkey off of my back with an ice pick please let us know if you notice anything fishy (notify us as gently as possible please, you know my ego is fragile, and i haven't been hugged in a hot minute) peace and chicken grease, ya heard? love, - hoopes leave forum posts here: http://libsyn.com/forum/viewtopic.php?t=980 Category: Stats -- posted at: 7:57 PM Comments[2] |
Fri, 9 September 2005 Update from apple:
We know many of you are receiving warnings from iTMS that there is a problem with your feed, preventing it from being updated in iTunes. We have checked several of the feeds in question and found them to be valid. You can test your own feed by visiting FeedValidator.org. We have contacted the good folks at Apple asking for clarification on what exactly the error it is, so we can determine what steps need to be taken to get your feeds updating in iTunes again Category: general -- posted at: 5:01 PM Comments[8] |
Fri, 2 September 2005 If you donate $50.00 to the Red Cross Hurrican Katrina relief fund we will give you a 1 year account of the Podcast Basic service. Sign up for a new Podcast Basic account. Submit it, but stop at the payment processing section (paypal.com). Email us a copy of your donation receipt and we'll active your account for a year.
Is there anyone out there who is willing and able to match every dollar our new libsyn customers are donating? Category: general -- posted at: 8:31 PM Comments[0] |
Tue, 30 August 2005 Updated Wed 8/31 2:39am EDT We are getting occasional reports of file downloads being cut-off. We are working to try and figure out a connection between the incidents of file truncation. Please email support@libsyn.com right away if you are experiencing similar issues. Category: Bugs -- posted at: 12:30 AM Comments[6] |
Fri, 26 August 2005 As you look around the advanced settings tab of your libsyn account, you will see 2 new checkboxes: Both of these are upcoming features we are about to debut. As with everything libsyn, we don't want to force anyone into something they're not comfortable with, so we're giving you the option whether you want to be included in our rankings and if you would want to open up your statistics to public knowledge. There are many podcasting directories that wish to use the stats to put together a ranking. We're not sure if we want to do it or not.. so we're leaving it up to you to decide. You can choose to just be in our ranked list, and not be part of a feed we offer to 3rd party partners. As always, you can trust us that we won't do anything lame with your information. Category: Feature -- posted at: 12:39 AM Comments[1] |
Thu, 25 August 2005 Thanks to some encouragement from Ray Salinski of iPodderX, a directory of libsyn podcasts are now offered as an OPML feed. This will help to ensure that libsyn podcasts are listed in the iPodder Lemon, iPodderX, iPodder.org, and other directories. The libsyn directory OPML feed can be found here: http://www.libsyn.com/directory/libsyn.opml Libsyn users: to be included in this feed login to your account, click the settings tab, and check the box at the bottom of the page "list my podcast in the libsyn directory." Then click "save changes" and you will be ready to rock. Category: Feature -- posted at: 10:35 AM Comments[3] |
Thu, 25 August 2005 There were some browser compatibility issues with the latest template, "Ku-Blue." The template has been repaired. To apply these changes to your page, login to your libsyn account, click the settings tab, and then click templates. Then scroll down to the Ku-Blue template and click the link "use this template." Note: You'll need to re-add any customizations you made to the page. Thanks to Paul Wilch for pointing out and fixing the problem. Category: general -- posted at: 9:50 AM Comments[1] |
Tue, 23 August 2005 We have recently implemented a caching mechanism for the rss xml files. The intent is to greatly improve the response time for xml feeds, and overall site and blogpages.
As with everything, we test to the best of our ability. However, please do us a favor and double check your RSS feeds whenever you make any changes like:
add a new post make changes to the settings modify old posts Thank you. Category: RSS -- posted at: 4:20 PM Comments[2] |
Thu, 18 August 2005 Hey everyone. Just like Sam Beckett We're trying to set right what once went wrong. If you feel your stats numbers are being reported in error, please respond to this forum post asap and we will look into the issue. Category: Stats -- posted at: 11:47 PM |
Wed, 17 August 2005 We discovered a bug last week which was preventing QuickCasts from being created, and was at the same time leaving "phantom" files in some users /quickcast folder. This was resulting in inflated disk-usage reporting and for some, unwarranted "You've exceeded your disk quota" e-mails. This bug has been fixed, and any files lingering in your /quickcast folder have been removed. Please let us know if you have any problems with the libsyn QuickCast feature (or any other libsyn feature for that matter). Thanks! Category: general -- posted at: 8:23 PM Comments[2] |
Wed, 17 August 2005 This has been a long requested feature which has finally come to fruition. When a listener posts a comment to your blog page, they are now required to verify that they are a human being by entering a series of numbers that appear in an image above the submit button. This method is known as CAPTCHA (Completely Automated Public Turing test to tell Computers and Humans Apart). Yeah, it's a mouthful, but it's also a widely-used method for preventing spam like we've been seeing on your blog pages. Post a comment here on the support blog to let us know your thoughts on this. Category: Feature -- posted at: 8:12 PM Comments[11] |
Wed, 17 August 2005 We are temporarily disabling the promo-swapping feature. We are working with Kiptronic to resolve a bug and get it back online asap. The truncated file downloads some of you have been experiencing, we believe, may be related. Libsyn and Kiptronic are working hard to ensure smooth, seamless promo swapping operation. Thank you. Category: Media Delivery -- posted at: 6:24 PM Comments[0] |
Tue, 16 August 2005 You can now 'Allow comments' when creating a new post... Or, you can choose not to.
We realize this isn't a major feature release, but it's been in demand for a while so we just wanted to let everyone know it's available to be used.
There is another update coming out soon to address the issue of comment spam.
Thanks. Category: Feature -- posted at: 12:53 AM Comments[5] |
Sun, 14 August 2005 Thanks to everyone for helping us track down and eliminate the bugs in this system. Here are some of the big ones we fixed this week: iTunes not accepting RSS feed Media Delivery Failing For Some Files
Multiple Language Support for RSS Feeds Category: general -- posted at: 3:19 PM Comments[4] |
Sun, 14 August 2005 We have brought several more media nodes online tonight- both current media and archived data. Hopefully this will bring the overall speed of the delivery up all around the system.
There are some speed issues with the blog pages that we have been noticing, and are working on making that better. We think there are caching things we can do in addition to rewriting some db stuff. Category: Media Delivery -- posted at: 12:14 AM Comments[0] |
Fri, 12 August 2005 Good evening everyone. In the ongoing saga of accurate stats about your podcasts, our team is working hard to redesign some aspects of how we are doing things to be much more efficient. Our previous iterations were not designed to scale to 1100 users serving millions of file requests.
We are building and learning as we go. It's the libsyn way.
Thank you for your understanding Category: Stats -- posted at: 2:12 AM Comments[5] |
Thu, 24 February 2005 Earlier this month, we started up the Liberated Syndication Community Forum, your typical web forum that you use to post questions, problems, feature requests, etc. Currently, your forum account is separated from your main libsyn account. Look for integration of the two accounts to come soon however. Category: general -- posted at: 12:50 AM Comments[6] |
Sun, 6 February 2005 If you are currently running and mainting your own weblog, using any number of RSS 2.0 supporting software and really just need a better place to host your media files, we have just what you need. When you upload your files to libsyn.com, either via the web interface or through FTP, they are then accessibly at http://libsyn.com/media/support. Simply point your enclosure url to that path and the name of the media file you uploaded. For the full syntax of what you need to include, click on the media files tab. Then click on the name of a file you uploaded. You will see the validated RSS 2.0 complient code that you can then copy and paste into your own feed. Category: general -- posted at: 12:52 AM Comments[41] |
|
Libsyn Support Blog Weblog of the status of the Liberated Syndication System.
|
|||||||||||||||||||||||||||||||||||||||||||||||||
