TwitterBridge and web interface Home view: (mostly) infinite loop of posts?

cy8aer

Hi there,

after creating a TwitterBridge and setting "Import my Friends Timeline" only I thought everything works fine. But after doing a new dent and viewing my Home view I found my post missing between my friend tweets/dents. Then I found on the web interface all the friend tweets looping all over the last pages and about page 50/51 the loop ends with my dent inserted between the friend tweets in the last loop.

When looking at the timeline with a client, like Choqok everything looks fine (all tweets once, my dent at the right point between the tweets).
Then I checked the MySQL database and found every notice once only. A simple check (mysqldump | wc -l) proved that my database is not growing (as it should be when the posts are inserted in a loop).

Is this a configuration problem or a bug in the web interface Home timeline? (status.net 0.9.0 and git head have this problem, I did not try the TwitterBridge with earlier versions)

aric

Ahh yes, is this not in the documentation. it should have a default setting me thinks.

// Twitter integration source attribute. Note: default is Laconica
$config['integration']['source'] = 'sitename';

cy8aer

It is in the doc, e. g. in the sample config file. Sorry.

cy8aer

But it has no effect (I only import the twitter timeline and do not post into twitter so a loop to twitter and back should not be possiuble). It looks like every new update of the timeline is not correlated with the posts are allready imported.

aric

cy8aer funky. @zcopley could you give this a gander?

cy8aer

(just another info: I already set the source integration via the web interface so that is the point why I did not do it in config.php)

cy8aer

It loops on clients too. Choqoc shows only the "last" posts and there my posts are missing between the imported timeline posts after some time.

aric

@zcopley have you seen this before? any ideas?

zcopley

@cy8aer @aric I'm having trouble visualizing the problem. Are you saying things are getting imported more than once? What's looping? Maybe a screenshot would help.

ThePfy

I'm having the exact same problem as @cy8aer - I've just upgraded from a 0.8 release to 0.9.1, and changed the TwitterBridge settings in my config.php to work with 0.9.1.

Everything did seem fine when I was first running the updated version - but after leaving it overnight, I'm getting the "looped" view of dents/tweets. I've taken a look in the database and there does only seem to be one copy of the imported tweets in there, but for some reason I'm getting this looped view on the web interface - I'll attach some screenshots of what I mean. I've also checked the server and there does only seem to be one running copy of the twitterstatusfetcher.

Like what @cy8aer is experiencing, I think it also affects clients/API as well - Twitterrific on Mac seemed to show most of the tweets/dents, but Tweetie 2 on the iPhone got mighty confused with this "loop" and only showed a few of the tweets/dents.

Links to some examples (this is me going through the various pages of tweets). Keep an eye on the 'del_n' tweets to see the looping :-

http://pfy.me/images/loop1.jpg
http://pfy.me/images/loop2.jpg
http://pfy.me/images/loop3.jpg

aric

@zcopley looks like it has somthing to do with pagination..

sam

I am having the same issue.

Sarfaraz

@sam @ThePfy @cy8aer I had similar issue... please disable cache if you site is not having heavy traffic.

sam

Thanks @Sarfaraz . I would appreciate if you could provide more detail on how you disabled the cache.

Sarfaraz

@sam sorry I meant queue... pelase add below lines to your config.php (ofcourse with //)

Then stop the daemons and start it again.

//$config['public']['localonly'] = true;
//$config['queue']['enabled'] = true;

sam

thanks @Sarfaraz . I can not disable queue since I am using meteor in my site.

sam

any suggestion?

aric

@sam are you using memcached? can you pastie some logfiles?

smscotten

@Sarfaraz I don't understand. How does adding two commented lines change anything? Are you suggesting commenting them out if they are present?

I think this may be the same problem I'm having. My statusnet site shows the same 17 status messages over and over again over the course of 50-odd pages. My database has a couple thousand messages in the notice table, but I can't see them on my site. No notices from identi.ca or other statusnet sites are showing, only 17 from Twitter.

Might this have something to do with individual notice views of notices that originated over OStatus get redirected to the original site?

http://status.smscotten.com/notice/2609 shows a Tweet
http://status.smscotten.com/notice/2611 redirects to Identica.

Could the stream view be "confused" about the correct display behavior?

aric

@smscotten did you add some sort of hack to make the twitter messages public? normally those are only visible when you are logged in, to skirt privacy problems that our importer does not handle

can you try running
php scripts/setconfig.php integration source smscotten

smscotten

@aric I've done no hacking. Mine is a single-user site, but other than that my site is exactly as it came off the shelf (ie Dreamhost one-click install).

My guess is that my site "believes" that it is only publishing the non-twitter posts. 50 pages times 20 notices == 1000 notices. The number of non-twitter posts in my DB is 1167. I think it's trying to display the regular notices and substituting the most recent 17 twitter notices.

I mean, just a theory.

Anyway, I ran /usr/local/php5/bin/php scripts/setconfig.php integration source smscotten

Is there something I should do next?

sam

hi @aric. I don't think I am using memcached. how can I check if I am using or not? also which log file do you want to see?