Python 3 Is Coming To Scrapy (scrapinghub.com) 87
New submitter Valdir Stumm Junior writes: Scrapy with beta Python 3 support is finally here! Released through Scrapy 1.1.0rc1, this is the result of several months of hard work on the part of the Scrapy community and Scrapinghub engineers.
This is a huge milestone for all you Scrapy users (and those who haven't used Scrapy due to the lack of Python 3). Scrapy veterans and new adopters will soon be able to move their entire stack to Python 3 once the release becomes stable. Keep in mind that since this a release candidate, it is not ready to be used in production.
This is a huge milestone for all you Scrapy users (and those who haven't used Scrapy due to the lack of Python 3). Scrapy veterans and new adopters will soon be able to move their entire stack to Python 3 once the release becomes stable. Keep in mind that since this a release candidate, it is not ready to be used in production.
What the fuck is Scrapy? (Score:5, Insightful)
What the fuck is Scrapy?
Re:What the fuck is Scrapy? (Score:4, Funny)
What the fuck is Scrapy?
Pretty sure it's that irritating dog they added to scooby doo to try to inject new life into it but which only made it worse.
Re: (Score:2)
That was Scrappy. Scrappy, Scrappy Poo, what are you?
Re: (Score:2)
What the fuck is Scrapy?
You are a geek . You read the word scrapy along with the word python. The word is strikingly similar to the word scrape. You asked the above question.
You are not a geek
This should help: (Score:2)
http://lmgtfy.com/?q=what+is+s... [lmgtfy.com]
Re: (Score:2, Informative)
Nope, that link just goes to a page that says:
let methat for you [sic]
[Google Search] [I'm Feeling Lucky]
Enable javascript to use LMGTFY.
Re: (Score:3)
By your logic, all the Slashdot editors have to do in their summaries is say "there's some news, head to a news site to find out what it is!" Having to google what a summary is talking about means that it is a bad summary.
Re: (Score:3)
It's the sheep equivalent of mad cow disease.
Re: (Score:1)
Mad cow disease is for cows! You are all cows, moo?
Re: (Score:2)
I thought they were talking about a Debian or Ubuntu release but the alphabetizing of version numbers is off.
Re: (Score:3)
I had scrapy once but the ointment cleared it right up.
Re:What the fuck is Scrapy? (Score:5, Informative)
Scrapy (/skrepi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.
Re: (Score:1)
Scrapy (/skrepi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.
And their tagline is "Scapy is crappy"?
Scrappy Malkovitch (Score:1)
three problems scrappy solves:
1. Scrappy Scrappy Scrappy? Scrappy, Scrappy Scrappy, Scrappy Scrappy.
2. Scrappy Scrappy: Scrappy, Scrappy Scrappy!
3. Scrappy, Scrappy Scrappy Scrappy. Scrappy Scrappy Scrappy, Scrappy Scrappy? Scrappy.
4. ?????
5. Profit!
Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy. Scrappy Scrappy Scrappy Scrappy. Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy? Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrappy Scrapp
Re: (Score:2)
What the fuck is Scrapy?
A rather ugly prion disease. It's like naming your new application Smegma or Pus.
Comment removed (Score:4, Funny)
Is it web scale? (Score:2)
Mongo DB is webscale.
WTF Is Scrapy? (Score:5, Insightful)
Jesus christ I hate submissions like this. Not only is it a blatent product-pimping ad, they cant even be bothered to explain WTF they are pimping.
Re: (Score:1)
Re: (Score:2)
it's New Editor Day, though I'm not sure yaelk is any improvement over timothy.
Re: (Score:2)
I know none of this stuff in either in Ruby or Python. Just doing a quick google search it seems the Ruby equivalent to Scrapy is Nokogiri. Anyone aware of the trials and tribulations Nokogiri users had with Ruby versions as compared to Python users and their Scrapy?
Re: (Score:2)
is there a direct equivalent to Scrapy?
Re: (Score:2)
Thanks, Obama. (Score:1)
This is the most amazing thing I have ever heard! Scrapy is ... a thing, which ... does ... stuff, and now I can use things which do stuff with Python ... 3 is it? I can hardly contain my joy.
Re: (Score:2)
I also fail to see the big deal.
Re: (Score:2)
This is the most amazing thing I have ever heard! Scrapy is ... a thing, which ... does ... stuff,
I know, isn't it incredible? It's the most amazing thing I've never heard of. I can't wait for another "article" about some "thing" that does "stuff".
Thank you, Slashdot editors, for maintaining the high journalistic stands we've come to never, ever expect!
Re: (Score:2)
Who is this "yaelk" submitter anyhow? He or she makes an overworked timothy look like an outstanding editor in comparison, and that's quite an achievement.
Re: (Score:2)
He or she makes an overworked timothy look like an outstanding editor in comparison,
A monkey with a severe head injury would look like an outstanding editor in comparison with timothy.
Re: (Score:1)
Re: (Score:2)
Can yo condense that for me? Perhaps submit it to /.?
Re: (Score:2)
That's worth at least $10 million in crowd funding!
This (Score:4)
This is the sort of thing I mark as Binspam in the Firehose. Blatant advertising.
Unfortunately I was doing other things when it popped up.
Re: (Score:2)
Eh, I don't think I agree with you. Scrapy is a free software project.
The story is on a site called practicalecommerce.com; if the story had been "come visit practicalecommerce.com! We have new stories! I can't believe #3!" then I would agree with you. But this is announcing that there is one fewer project that depends on Python 2.x, and I'm happy to hear it.
Feel free to disagree with me, but I'll still Binspam it when I see it. Yes it is news, but it is boring as shit news that is only relevant to the few people who use the service. /. is all about the discussion yet there is nothing to discuss here. It is purely a product announcement for some minor system and nothing else. If it was some new revolutionary project that promised the world it would be a different thing. But it isn't. If it was some new announcement by tech visionary then it would generate
Re: (Score:1)
Scrapy is a web spider (Score:4, Informative)
From the summary:
Scrapy with beta Python 3 support is finally here!
Here's how I would write it:
Scrapy, a web spider, now has beta support for Python 3.
This is why I get paid the big bucks.
Re:Scrapy is a web spider (Score:4, Funny)
"Scrapy, a web spider, now has beta support for Python 3."
TL;DR ;)
What (Score:2)
What the fuck is Scrapy? How do you even pronounce it? Scray-pee or Scrap-e?
Re:What (Score:5, Funny)
The "s" is silent.
Seriously, WTF is "Scrapy"?? (Score:1, Troll)
Seriously, would it be SO hard to include a couple of words about what "Scrapy" is? Just a couple of words?
Fuck it. You know, I had high hopes that the new owners of slashdot might exercise just the tiniest fucking bit of editorial skill or acumen, but I must be one of those perpetual optimists, doomed to disappointment.
Pro Tip to the "editors": When you write an article about something, it's considered good journalistic practice to explain potentially obscure references so people know what the fuck you're
Re: (Score:1)
Re: (Score:2)
speaks his wisdom from years of professional experience as an editor
You're absolutely right, Anonymous Coward...I've done technical writing and editing for 25+ years, and I'd never publish a content-free "article" like the ones so frequently found here. So yes, I do have "years of professional experience as an editor", decades, actually.
I've worked for Boeing, Microsoft, AT&T, Sprint, Fluke, and quite a few other companies in the past, and, unlike you, I know whereof I speak. Also unlike you, I don't hide behind an anonymous account when I voice an opinion. :)
Now go bac
Re: (Score:2)
Anonymity doesn't make or break arguments, nor does relative financial success.
Re: (Score:2)
Anonymity doesn't make or break arguments, nor does relative financial success.
Sometimes it does.
If you say "You'll never make a dime selling widgets because no one wants widgets", and you subsequently make a million dollars selling widgets, then the financial success does seem to indicate that people do indeed want widgets, rendering the "no one wants widgets" argument wrong.
And if you'll notice, AC made no argument, he simply made a bunch of ad hominem attacks and unfounded assertions. I didn't actually see an argument in his rant, perhaps you could point it out.
Additional information (Score:5, Informative)
We expect better under new management (Score:1)
You make it sound like the criticism is not warranted. It *is* warranted, the blame being split squarely between:
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
And all 3 of you that use it or care already know about python3 support, and the entire rest of the Internet doesn't give a fuck.
I know this because I have github projects that aren't working at all with more pull requests and forks than you have and I didn't do any spam advertising on slashdot for them.
Slashdot is not a ad platform for your little pet project to reimplement (poorly) something that has been done properly at least 10 times already and done poorly like your hundreds of times.
Re: (Score:1)
http://www.amazon.com/Web-Scraping-Python-Collecting-Modern/dp/1491910291/ref=sr_1_1?s=books&ie=UTF8&qid=1454730640&sr=1-1&refinements=p_27%3ARyan+Mitchell
Cool! (Score:2)
Thank God (Score:2, Funny)
1) Lack of Python 3 support
2) Knowing what Scrapy is
Now only 2) is the thing that is keeping me from using it!
Re: (Score:2)
all the cool kids use Ruby
https://www.youtube.com/watch?... [youtube.com]
Dear New Slashdot Ownership: (Score:2)
Something you may appreciate while reading this thread is that Slashdot users are very, very intolerant of advertising motivated-clickbait like this. We're here for, what was the phrase?..."News for Nerds"; thought-provoking science and technology discussions. We're not here to give our eyeballs all day to every website that paid you a few bucks to steer clicks to their new shiny product, though we realize bills need to be paid.
If you're looking for ad revenue, you need to be smarter and less obnoxious abou