How ChinesePod is Dealing with Technical Issues

hankfdh
August 16, 2010 at 10:03 AM posted in General Discussion

Guys,

Thanks for all your feedback on the site. We appreciate the fact that you care enough about ChinesePod to give us these comments.

Broadly speaking the technical issues ChinesePod are facing can be broken down into four categories:

  1. Issues that are not directly under our control that we are working to resolve ASAP,
  2. Issues that are genuinely because of lapses in our own testing process,
  3. Design issues, and
  4. Communication issues within our own staff and between our staff and our students.

Specifically with regards to #1, some of the ChinesePod blog and forum sites have been under attack by malicious third-parties. These vulnerabilities are the result of weaknesses in the third-party software (e.g. WordPress) that we use for these non-core sites. Our team is working to cleanse these sites of malicious code and then get Google to confirm their health and remove any warning messages. As for the slowness in the site, on Friday we suffered some hardware failure on our primary web server, which is hosted at a third-party location in the US, so we moved the ChinesePod.com domain to our backup server in order to maintain access over the weekend. We have been relying on this third-party partner to support us in resolving these hardware issues and hopefully things will be back to normal soon. Hardware does fail and the challenge is to be prepared for when it does and get things back to normal ASAP.

As for #2, the quality control of our software development has been weak. We have been addressing this issue for the past few months and have seen an improvement. While some issues, such as authentication for the iPhone, have slipped through we are continuing to stress the importance of quality internally.

As for #3, this is a more challenging issue to address. In the Spring, we added Dashboard functionality to solve many of the problems our Teacher Service students were having. While we did solve many of those problems, the new design inadvertently caused new problems for many of our Subscription students. Going forward, to ensure that we do not make big changes that result in negative results we will be using a much more strict testing framework to gauge the results of any future changes. This framework will heavily rely on quantitative A/B testing in addition to the qualitative feedback we get from our students to validate any adjustment we make to the learning experience on the site.

From Day 1 almost five years ago, we have been big believers in the ability of web & mobile technologies to help improve the experience of learning languages. I believe we have been very aggressive in trying to integrate new technologies as they emerge and do hope that this is something ChinesePod will continue to do many years into the future. Maintaining high quality standards needs to be a more integral part of that mission.

As for #4, we have over 50+ staff here at ChinesePod and it is sometimes hard to restrain the eagerness of our staff to engage in on site conversations. To help bring some order to this we are starting to be much more strict about the subjects our team will get involved with. Specifically, any bugs or clearly broken features will be handled by Peter Ning our customer support representative. Any academic questions and feature improvements will be handled by Catherine Mathes, John Pasden and the rest of our Publications team. Any issues related to Teacher Services will be handled by Rob Villanueva.

Please let me know if you have any other questions.

Thanks,

Hank.

Profile picture
hankfdh
August 20, 2010 at 01:19 AM

@xiaophil,

I hear you. I am assuming what you mean by 'disarray' is the the complexity and, frankly, awkwardness of the lesson management features on the site. In retrospect, the team tried to support too many types of users with only one type of tool resulting in something that was confusing for everyone. I am guilty of letting this happen.

To address this we are taking two actions. First, over the next few weeks we will be trying to remove some of the 'stupid' with the current system. Look for John and Catherine to kick off a discussion about the changes we are thinking about implementing late next week. In brief, the thinking is to separate the lesson presentation for My Lessons and My Courses into two separate pages and two feeds with the result that My Lessons will go back to how it worked in the past and My Courses will continue to support our Teacher Service students while not affecting our Subscription students.

Second, we have been thinking a lot about the process in how changes do get made. What we don't want to do is stop innovating because we are afraid of what might result. Instead, we want to be able to continue to roll out new types of web and mobile technologies to make the learning of languages easier. That said, we must be able to avoid disruptions and confusion over poorly designed initiatives like the Dashboard. As a result, going forward any initiative that isn't a 100% obvious improvement will need to go through a much more disciplined process of A/B testing and qualitative feedback to ensure that the change is actually having the expected impact that it was designed to. 

I sympathize with your frustration and am grateful that despite of it you continue to support ChinesePod with your feedback.

Thanks.

Profile picture
paulinurus
August 22, 2010 at 04:42 AM

Glad to hear that Cpod will be taking a structured approach from now on and will cease the frequent off-the-cuff tinkerings which only worsen instead of improve users experience using the site. I had wanted to renew my subscription but held back because of the annoyances. I'll be glad if Cpod would reinstate the old lesson management system - I found it easy, convenient, and effective compared to the convoluted Dashboard system.

As for Phil's point of the subscription fee of basic subscribers to subsidize the services for premium and guided students, I agree that this is unfair. But besides the issue of fairness, it could also prove to be a misguided pricing strategy. Basic subscribers are budget conscious clients or hobbists rather than people needing to learn Mandarin for career or business aspirations. There would be less renewals and postponing of renewals - killing the masses whose contributions, albeit modest, have in the past fed the fixed costs of the business. Once a student has subscribed, he already has downloaded all the lessons he needs, so his musing will be " do I need 52 weeks of more lessons at that price?

Masses support the fixed costs. Profits come from the premium and guided subscribers. So raise their fees... not only can they afford it, they need your services more.

Profile picture
tvan
August 20, 2010 at 12:47 PM

Not to beat a dead horse but, if it makes you feel any better, I'm on the guided plan, and it was just as bad for me as it was for you.

Profile picture
xiaophil
August 20, 2010 at 09:17 AM

Hank,

Tal got my meaning about 'disarray.' He also seems to have got my feelings in regards to how all these changes have affected people like myself who have a basic subscription.

I think I'll leave it at that. Thanks for replying.

Profile picture
hankfdh
August 20, 2010 at 02:24 AM

tal_,

We are trying to take a structured approach to these issues going forward. Bugs and quality control are covered in point #2 above.

Profile picture
Tal
August 20, 2010 at 01:51 AM

I have an idea that what he means by 'disarray' actually includes stuff never working properly. The list of bugs and onsite annoyances seems endless, and every week it seems there's a new one (or two, or three, or four).

And xiaophil is bang-on-target re. his comments on the apparent exploitation of Basic Subscribers.

Anyway, nice to hear from you Hank. It's so comforting when you notice us little people not paying through the nose for whatever the latest package is or doodling the time away on iPhones.

Profile picture
xiaophil
August 19, 2010 at 11:55 PM

Hank,

I haven't had much time to check in recently, so I'm only just now getting to this.  Thanks for your detailed response.  I'm also glad to see the main server seems to be back online.

Let me just say my mind.  The website has been in disarray for over 8 months now.  I'm a basic subscriber.  I don't have the other functions and specialized services that other users have.  I basically have the podcasts and some online feedback via CPod staff and other users.  Therefore, having the glitchy website is perhaps more irritating for a person like me than others.

It is especially hard to accept because CPod significantly increased the price of basic subscribers some time ago.  This is after watching other users get new functions such as Skritter.  Now we find out that the Dashboard change was to help facilitate communication between teachers and their students.  I know that you guys feel the price increase was justified because there hadn't been an increase in some time.  But take a look at it from my end.  Where is that extra money from the basic subscribers going to?  Paying to have had Skritter and other functions added to the website which I can't use?  Paying for the creation of the dashboard and the fallout from it just to benefit teachers and their assigned students?  Also I can't help notice that we are not given a timeline for when we can expect these difficulties to be cleaned up.   We are only told that staff is working very hard.  It feels so endless to me.

Can you understand why I would be dismayed?  I really don't want to give you guys trouble.  I don't want the staff on your end to groan when you see that I am pointing out a flaw.  I really do like, liking CPod.  But dang.

Profile picture
pretzellogic
August 16, 2010 at 10:46 AM

Hankfdh, I'm curious about where site improvements such as the Progress tracking beta are in these four categories.  It looks as if the Publications team is responsible for site improvements.  I see the progress tracking beta as a helpful potential improvement with the incorporation of user feedback.  I realize that the beta may be rethought with other priorities now being worked, but still would love to see further development and user feedback incorporated in the beta.  Thanks.

 

Profile picture
pretzellogic
August 17, 2010 at 06:44 AM

hankfdh, thanks for the feedback.

Profile picture
hankfdh
August 17, 2010 at 01:03 AM

Indeed, the Progress Tracking feature falls under our Publications team. I believe the next two projects they are working on are (a) improving lesson discovery and (b) improving lesson management, but I will pass your request along.

Profile picture
hankfdh
August 16, 2010 at 08:18 AM

matthiask,

John Biesnecker is handling issues regarding mobile development (iPhone and Android) as well as our API. He is coding out the iPhone app himself and working with the Chinese Android developers in our team. They are working to get both apps to support the groups architecture on the site (version 2.0) and then they plan to release a version with minor updates every week. Feature requests are funneled through a variety of our communication channels and added to a "Feature Wish List" that the team evaluates and prioritizes every week.

As for bugs, these are filtered through our customer support team and acted on ASAP. A lot of issues are the result of poor design and they take a little longer to work through as we are trying to be more methodical with our future updates to avoid creating new problems.

As for academic issues, internally we produce a daily report that highlights discussions that our academic team need to respond to. If that is not happening, Catherine Mathes the head of our Publications team will look into it.

 

Profile picture
matthiask
August 17, 2010 at 07:43 AM

Hi Johnb,

valuable information there. thanks. I will put the inssues and wishlist items into the thread. - would be nice if we can have a ChangeLog from your side in there as well.

Profile picture
johnb
August 17, 2010 at 01:40 AM

Hi Matthiask,

I'll admit, I wasn't aware of that post (though the issues you raised are ones that have been raised before, and that we're working on). It would really help if you post technical issues like that in the Technical Issues group, rather than on lesson comment threads -- while we do our best to scan all comments, if they're in the Technical Issues group they're certain to be seen by technical staff, where as comments in lesson threads have to be routed through the company and do sometimes fall through the cracks).

In addition, I've opened up an Android/iPhone app wishlist thread in the general discussion group. Would very much welcome your feedback there.

Profile picture
hankfdh
August 17, 2010 at 01:01 AM

I will pass your requests along.

Profile picture
matthiask
August 16, 2010 at 09:31 AM

Is JohnB aware of

http://chinesepod.com/lessons/endless-summer#comment-188376

then?

I started to rely heavily on the chinesepod app, as it is was an awesome tool to quickly access the content on the go.

I'd seriously would like to have back my personal feed.

Want background lesson loading (see Aldiko reader - books are downloaded in the background and the app stays usable)

And lastly I'd require easy access to the dialogue file including repeat and slowdown.

One last thing as a learner: Chinese fonts should always be larger than English fonts just for the fact that they have way more elements in themselves.

Success with upgrading the site structure!

Profile picture
matthiask
August 16, 2010 at 07:58 AM

Hi Hank,

thanks for your clear words on how Cpod is handling issues.

A few questions are left open for me:

Who will handle requests for mobile apps? The recent android update was a disaster and nobody seems to care or communicate about it.

Will it ever change that bug reports, problems on site or feature requests feel like begging? It needs severe repetition of an issue before there is even an answer from the cpod team - if any.

What is the policy regarding academic questions? I often see over the last months that questions will not be answered when asked in the community.

Matthias

Profile picture
matthiask
August 16, 2010 at 09:59 AM

regarding the last question: I might have been a bit harsh on this. An investigation has shown that many questions (if not most have been answered in the meantime and a friendly "bump" seems to attract the attention of the CPod team better than i would have expected)