redirection to feedburner doesn't work with netvibes anymore

Found a bug? Tell us!!
Post Reply
User avatar
rowi
Regular
Posts: 77
Joined: Fri Mar 16, 2007 9:10 pm
Location: Flensburg / Germany
Contact:

redirection to feedburner doesn't work with netvibes anymore

Post by rowi » Fri Mar 23, 2007 12:40 pm

Hi,

since the last update of netvibes it's crawler doesn't follow the redirection to feedburner anymore. Although this is a change (and propably bug) of netvibes I noticed that the redirection still works with e.g. Robert Basic's WP based blog.
The only difference I noticed is a different status code. S9y returns a 302 to the reader, WP a 307:

Code: Select all

$ wget http://www.basicthinking.de/blog/feed/
--11:53:24--  http://www.basicthinking.de/blog/feed/
           => `index.html'
Resolving www.basicthinking.de... 85.214.23.218
Connecting to www.basicthinking.de|85.214.23.218|:80... connected.
HTTP request sent, awaiting response... 307 Temporary Redirect


vs.

Code: Select all

$ wget http://rowi.standardleitweg.de/feeds/index.rss2
--12:05:01--  http://rowi.standardleitweg.de/feeds/index.rss2
           => `index.rss2'
Resolving rowi.standardleitweg.de... 212.7.153.37
Connecting to rowi.standardleitweg.de|212.7.153.37|:80... connected.
HTTP request sent, awaiting response... 302


I tried to confirm this but unfortunately I wasn't able to find the place within the source where the status code is set :(
Again, I'm aware this is more a bug of netvibes (and already reported it to them) but I hope we can fix this for the short term within s9y. At least I would like to try it.

For now I've disabled the redirection to feedburner

User avatar
garvinhicking
Core Developer
Posts: 30020
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Re: redirection to feedburner doesn't work with netvibes any

Post by garvinhicking » Fri Mar 23, 2007 12:53 pm

Hi!

The redirection can be found inside rss.php:

Code: Select all

                header('Location: ' . $url);
                exit;


you can try to use

Code: Select all

                header('HTTP/1.0 307');
                header('Location: ' . $url);
                exit;


instead. But actually, 302 and 307 should be RFC-wise identical and lead to the same behaviour. It sounds definitely like a bug by netvibes, or an intended change. Maybe yuo should ask them how that change came about.

Best regards,
Garvin
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/

User avatar
rowi
Regular
Posts: 77
Joined: Fri Mar 16, 2007 9:10 pm
Location: Flensburg / Germany
Contact:

Post by rowi » Fri Mar 23, 2007 2:05 pm

Hi,

thanks for your quick reply. I tried wheather it works with the changed status code but unfortunately it's not as easy as I hoped, netvibes still doesn't follow the redirect.

Maybe someone has another idea, I've copied the headers from both feeds:

This response works with netvibes:

Code: Select all

HTTP request sent, awaiting response... 
  HTTP/1.1 307 Temporary Redirect
  Date: Fri, 23 Mar 2007 12:36:08 GMT
  Server: Apache/2.0.54 (Debian GNU/Linux) PHP/4.3.10-16
  X-Powered-By: PHP/4.3.10-16
  X-Pingback: http://www.basicthinking.de/blog/xmlrpc.php
  Last-Modified: Fri, 23 Mar 2007 12:03:50 GMT
  ETag: "acd9feb2a337d7c16ae3079ccc1fcea0"
  Location: http://feeds.feedburner.com/basicthinking/doho
  Connection: close
  Content-Type: text/html


whereas this doesn't:

Code: Select all

HTTP request sent, awaiting response... 
  HTTP/1.1 307
  Date: Fri, 23 Mar 2007 12:32:21 GMT
  Server: Apache/2.0.48 (Fedora)
  X-Powered-By: PHP/4.3.4
  Expires: Thu, 19 Nov 1981 08:52:00 GMT
  Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
  Pragma: no-cache
  X-Serendipity-InterfaceLang: de
  X-Blog: Serendipity
  ETag: "Fri, 23 Mar 2007 09:17:00 GMT"
  Set-Cookie: PHPSESSID=a2d785b9f8fc8e63659fa4283ffeec1f; path=/
  Last-Modified: Fri, 23 Mar 2007 09:17:00 GMT
  Location: http://feeds.feedburner.com/DerStandardleitweg
  Content-Length: 0
  Keep-Alive: timeout=15, max=100
  Connection: Keep-Alive
  Content-Type: text/xml; charset=utf-8


I still haven't got a response from netvibes and I don't think it's s9y's fault but I if there a simple solution as changing a header to please the crawler for now I'd like to do this.

User avatar
garvinhicking
Core Developer
Posts: 30020
Joined: Tue Sep 16, 2003 9:45 pm
Location: Cologne, Germany
Contact:

Post by garvinhicking » Fri Mar 23, 2007 2:17 pm

Hi!

Did you try to use HTTP/1.0 307 as I mentioned? I saw you put HTTP/1.1 there, that might not work.

[quote="rowi"]Hi,

thanks for your quick reply. I tried wheather it works with the changed status code but unfortunately it's not as easy as I hoped, netvibes still doesn't follow the redirect.

Maybe someone has another idea, I've copied the headers from both feeds:

Those headers here:
[quote] Content-Length: 0
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: text/xml; charset=utf-8
[/code]

Mgiht be a problem, they should be Connection: Close instead. Don't know how that happens though.

But I'm pretty sure we'll need feedback from the netvibes people on that matter.

Best regards,
Garvin
# Garvin Hicking (s9y Developer)
# Did I help you? Consider making me happy: http://wishes.garv.in/
# or use my PayPal account "paypal {at} supergarv (dot) de"
# My "other" hobby: http://flickr.garv.in/

User avatar
rowi
Regular
Posts: 77
Joined: Fri Mar 16, 2007 9:10 pm
Location: Flensburg / Germany
Contact:

Post by rowi » Fri Mar 23, 2007 3:24 pm

garvinhicking wrote:Hi!

Did you try to use HTTP/1.0 307 as I mentioned? I saw you put HTTP/1.1 there, that might not work.

Yes, I tried 1.0 first and since it didn't worked I changed it to 1.1 for a test.

garvinhicking wrote:Those headers here:
Content-Length: 0
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: text/xml; charset=utf-8


Mgiht be a problem, they should be Connection: Close instead. Don't know how that happens though.

I already tried "Connection: close" but it didn't worked either. I guess I can't suppress the other headers?

garvinhicking wrote:But I'm pretty sure we'll need feedback from the netvibes people on that matter.

Yes, their crawler seems to be seriously broken since the coriander update :(

Thanks for your help

User avatar
judebert
Regular
Posts: 2478
Joined: Sat Oct 15, 2005 6:57 am
Location: Orlando, FL
Contact:

Post by judebert » Mon Mar 26, 2007 10:11 pm

Could it be a difference in the feedburner configurations for the two locations?

I don't see any way to "retract" a header line, so you'd have to find where those other lines are added and remove them. Perhaps a better debugging tool would be a small PHP script that duplicated the two headers? That way you could make changes in one file, instantly, and fool around with bits until it worked.
Judebert
---
Website | Wishlist | PayPal

User avatar
rowi
Regular
Posts: 77
Joined: Fri Mar 16, 2007 9:10 pm
Location: Flensburg / Germany
Contact:

Post by rowi » Mon Mar 26, 2007 11:24 pm

No, netvibes was broken:
netvibes wrote:Thanks a lot for your feedback, the seems to be in our side, our team is going
to works on this and to try to see if we quickly do anything.

they've fixed it this afternoon

Post Reply