DEV Community

Cover image for A bot that tweets new DEV articles about Vue

A bot that tweets new DEV articles about Vue

Daniel Elkington on March 03, 2019

So I love VueJS. And I love dev.to articles about Vue. And I don't want to miss any. I could just keep constantly refreshing the #vue tag on dev.to...
Collapse
 
ben profile image
Ben Halpern

Nice!

CC: @peter @michaeltharrington

As we expand our Twitter distribution we could definitely make use of some of this automation and community involvement would be pretty great. Just getting this on your radar.

Collapse
 
danielelkington profile image
Daniel Elkington

Should probably point out that this implementation is quite fragile - if dev.to at some stage added an API interface it would make this sort of thing much more robust than the current scraping solution😉

Collapse
 
ben profile image
Ben Halpern

Duly noted. We have some endpoints

dev.to/api/articles?tag=vue

But they’re pretty scattered. We’ll have more order to the madness in the near future.

Collapse
 
frontendwizard profile image
Juliano Rafael

Loved it. Awesome article. I’ve used puppeteer for automations like this before but it’s usually an overkill. I’ll try to replicate this by building a bot for React :) Thank you for the article.

Collapse
 
danielelkington profile image
Daniel Elkington

Thanks for the kind words; all the best with your bot!

Collapse
 
frontendwizard profile image
Juliano Rafael

Bot up and running on azure as well. The twitter profile is twitter.com/TheReactDev. I'll wrap it up tomorrow and put the code on GitHub. This stuff is fun!

Thread Thread
 
frontendwizard profile image
Juliano Rafael

One thing to note is that checking the extended_url didn't worked for me. Sometimes the twitter api handles me a twitter.com link instead of a dev.to link. Any ideas on why?

Thread Thread
 
danielelkington profile image
Daniel Elkington

Do you mean the expanded_url in tweet.entities.urls? I didn't have this problem 🤔. If you get stuck feel free to put your code on GitHub and I'm happy to take a look!

Thread Thread
 
danielelkington profile image
Daniel Elkington

@frontendwizard Just saw your React bot - it looks great! Especially like how you turned the dev.to tags into Twitter hashtags. Great work.

Thread Thread
 
frontendwizard profile image
Juliano Rafael

Thanks. Yeah, I mean the tweet.entities.urls. For some posts it does not return the dev.to url but instead returns a twitter.com link to the own link. I ended up fetching the tweets on extended mode and checking the title + author on the full_text. Not great but, it works.

Thread Thread
 
frontendwizard profile image
Juliano Rafael

I found the problem. You have to ask for the tweets with tweet_mode: "extended" on the statuses/user_timeline endpoint, otherwise you don't always get the posted url. Might be a quirk of the twitter API, I'm not sure about it. Was writing about this when I finally understood the behavior. That's why writing about what you're doing is so important! 😄

Thread Thread
 
frontendwizard profile image
Juliano Rafael • Edited

btw, the code is on Github now: github.com/thefrontendwizard/TheRe...

Collapse
 
jenlooper profile image
Jen Looper

Thank you for this!

Collapse
 
ashraful profile image
Mohamad Ashraful Islam

I was surprised to seeing this. idea is awesome

Collapse
 
davefollett profile image
Dave Follett

Great job not just on the idea, but bringing it to life! Proof its working:

Collapse
 
ecognito profile image
E Cognito

An RSS feed! An RSS feed! My kingdom for an RSS feed!