Tavern on the Meta

nicael

8:03 PM

@rene Lol nope.

Maybe an automatic flag?

rene

@nicael could be. I clicked Looks OK so you can keep your test post ;)

nicael

Could you provide the link to the review?

Ah wait

I can get it myself :)

rene

meta.stackexchange.com/review/low-quality-posts/44762

@nicael lazy?

nicael

:D

Interesting, if I delete, will the flag be deemed helpful?

rene

@nicael I think so, yes

nicael

8:08 PM

Anyway, deleted-undeleted.

I have no idea why would anyone flag it though.

It has two delete votes btw. Huh.

rene

You might have picked up some haters? Can't imagine how that would happen ...

nicael

@rene btw. Could you flag this comment as anything, please? need a test.

rene

gone ...

nicael

Thanks

Oh lol

rene

Let's hope that it keeps me clear of repercussions ...

nicael

8:12 PM

Thought I could edit it know, but it just disappeared once I clicked "save"

rene

You would need a mod to tell you if that edit made it into the backend

There are no websocket updates for comments, except the new comment notification

nicael

@rene I haven't made an edit, unfortunately. Clicked enter, thought it wouldn't disappear that fast.

rene

@nicael Ah, OK

josliber

!!/report stats.stackexchange.com/a/219658/40036

nicael

@josliber gone!

josliber

8:16 PM

@nicael Thanks! it had been lingering

Does !!/report not work anymore?

hichris123

@josliber No, all reports to the Tavern are on a 5-minute delay. That includes manual reports.

josliber

@hichris123 Ah cool, thanks

And howdy all; haven't been here in forever and a day

rene

Howdy !

dev alert

hichris123

Hey, Oded is here.

rene

He is going to explain what Nick broke this time ...

Oded

8:20 PM

Just to say - thanks for keeping an eye on meta and giving me more search targets for that careers spam.

Guess that now with careers being part of SO, it has become that much more of a spam target.

hichris123

:) I do think it should be brought up about allowing everyone to create a company page. Some of them are literally advertisements, not looking for employees at all. Like stackoverflow.com/jobs/companies/softoneglobal.

rene

There isn't a recent added Companies feed, right?

Oded

Don't think so, not as such.

rene

It would help if you could sort the company list on Creationdate

hichris123

@Oded Apparently they're still at it: stackoverflow.com/jobs/companies/… is new. There's also stackoverflow.com/jobs/companies/iubiubiu but that one was in one of my searches a while ago.

Oded

8:29 PM

Yeah, we can see them editing.

rene

Then you could crawl without having to visit all pages

@Oded uhh.. you switched the camera on their PC on and now you're watching them ... Cool ;)

hichris123

Isn't this a fun way to be spending your Sunday... fighting spammers...

@rene Fighting spam with... malware... ingenious? :P

rene

@Oded this one: stackoverflow.com/jobs/companies/followmyprofile

hichris123

What is the caching on that Companies list? It seems like some take only a few minutes to fall out but others take a half hour+.

> This service is 100% safe and secure, join us and become famous!

rene

I'm famous enough ...

hichris123

8:35 PM

@rene But you can get 20k Instagram followers!

And remember, it's safe & secure.

rene

I guess that comes with the requirement to create an instagram account first ...?

hichris123

Mm, maybe that comes with?

Or, if you don't like that @rene: you can get Facebook likes! stackoverflow.com/jobs/companies/firstfans

rene

Yes! 1000 Likes!

Oded

@rene not really part of the same batch, but removed :)

rene

OK

Oded

8:44 PM

Thanks

rene

What is the logic to sort these results? Are the companies without jobs (0 jobs) always first in the list?

hichris123

Ah, Google Translate. stackoverflow.com/jobs/companies/www-7llo8z-com

@rene It almost seems to be random...

Oded

@rene Yeah, I don't know. Was looking at that too (but was able to use an internal / careers mod page to find all the recent "companies" and remove the company pages)

rene

Scraping is going to be a headache this way

Oded

:(

rene

8:59 PM

I would probably be blocked by the HA-proxy if I tried

Oded

Anyhow - all the IPs that we saw are now blacklisted and also entered into spamram.

So - this wave is over, and we will be discussing spam prevention on careers tomorrow morning.

rene

Spamram also blocks Jobs then?

@Oded or allow community flagging?

Oded

@rene and allow for community flagging ;)

rene

Just do the quick win first ...

hichris123

in Charcoal HQ on The Stack Exchange Network Chat, 2 hours ago, by hichris123

I'm tempted to scrape the listing of Company Pages and see how many match...

Oded

9:03 PM

Oh yeah - certainly. I mentioned community flagging in their chatroom about an hour ago though ;)

hichris123

Sorry you had to spend your Sunday evening like this. :)

rene

@hichris123 on a slow pace it could work, but don't you need an extra fetch on each search result? Or do you only do a title match?

hichris123

@rene For a lot of those, the title alone matched.

!!/test Resource - If you are weight lifting then taking peptides is a must. You have to take the best bodybuilding supplements for your body. Visit researchpeptides.com to learn more.

SmokeDetector

> Bad keyword in title
----------
Title - Position 96-108: bodybuilding, Position 109-120: supplements

hichris123

That's stackoverflow.com/jobs/companies/melanotan.

rene

9:07 PM

@hichris123 you get only 15 results from this with 1251 pages

hichris123

Yeah. :( I was trying to see if there was a limit parameter or anything but it doesn't look like it.

rene

If you stay under 90 calls per minute or so the HA-proxy will not bark

Maybe mixed that up

hichris123

A call/second usually works.

For 1250 pages, that's 21 minutes.

rene

150 calls in 90 seconds is allowed

hichris123

Where'd you get that number?

rene

9:10 PM

@hichris123 here, I tested a bit

hichris123

Ah, science. :D

rene

but that is per IP so on a shared IP, well, you're screwed

hichris123

I have a static IP for just my modem so it's probably no issue.

rene

You write the scraper then?

hichris123

I guess. :P

rene

9:14 PM

OK, let me know if you need help but I only do c#

In python would be preferable because then you can re-use the regex from smokey?

hichris123

Yeah. It's not bad, since all I have to do is get .tagline and .title and then pipe them to Smokey.

rene

OK, I consider it done then ...

hichris123

9:39 PM

Okay, it's running. Hopefully 1/sec is respectful enough.

rene

@hichris123 If we don't hear back from you for 4 hours we know it wasn't ...

hichris123

wait nevermind I missed something... sigh.

rene

lol

hichris123

All companies have a title, but not all companies have a tagline.

rene

Yeah, the less you need to enter the quicker you can spam

Quill

9:51 PM

morning

meatball

morning

hichris123

Hmm, should I log the industries, tags, and location too?

rene

@hichris123 I dunno but tags can be handy. All the movie stuf had 3d models IIRC

hichris123

Alright, why not.

rene

I'm off to bed, so \i'm not going to see the end-result, sorry @hichris123

hichris123

10:09 PM

:( Well, night @rene!

hichris123

10:36 PM

Okay, scraping done. Now to run it through the regexes...

meatball

drum rolls

hichris123

10:54 PM

Results: gist.github.com/hichris1234/b408fbe69e086d25a5f915a0a4c4323f. Either the title or the tagline would be caught by Smokey on all of those -- some are quite legitimate though, since "URL in title" would catch any that have a URL.

But some are spam. Like stackoverflow.com/jobs/companies/arb-bearings is definitely spam.

Quill

stackoverflow.com/jobs/companies/…

hichris123

Hey, you can get a new window from them.

Huh, some of those are duplicates. I guess the sort really is random.

hichris123

11:12 PM

Okay, duplicates now removed from that.

hichris123

11:29 PM

@Oded Here's a list of "companies" that are very likely spam: gist.github.com/hichris1234/dd8ec804e95fa48ce343df456dfb5fa8. At best, some are advertisements -- none talk about work environment or why you should work with them.

Quill

Are you going to write up an email to careers@so?

@hichris123 Can you append the baseurl to those links next time pls :)

that really sounds lazy.... that wasn't my intention <_<

hichris123

@Quill I did, refresh the page. :)

Quill

:D

hichris123

(did as in 10+ minutes ago)

@Quill Email about what? "You have a huge spam problem"?

Quill

with the list

hichris123

11:36 PM

Oh, I guess I could. But Oded is probably a decent enough messenger. :P

Quill

there's a lot of listings in that list with non-latin characters

hichris123

Yeah. Some are really suspicious, some are just semi-suspicious.

Come on spammers, it's father's day. Knock this shit off.

Tweeted by Nick_Craver on June 19, 2016 at 8:12 PM

Dear spammers, I have altered your access our sites. Pray I do not alter it any further.

Tweeted by Nick_Craver on June 19, 2016 at 9:07 PM in reply to Nick_Craver

ah, I missed these. Poor Nick, always dealing with spammers at inopportune times.

Quill

> your access our sites

hichris123

twitterGrammarFailsFromThe140Refactor++;

Tweeted by Nick_Craver on June 19, 2016 at 9:41 PM in reply to Nick_Craver

Quill

Could you potentially scrape the job listings as well, @hichris123?

hichris123

11:50 PM

Potentially, yeah.

But there's no spam there... at least, I hope not. If a spammer is stupid enough to pay for a job listing...

Quill

2 days ago, by hichris123

> Upcoming event June 23rd, 2016, Burlington, Vermont

Yeah... uh, for sure, uh, they'd never, uh, they'd never do that

hichris123

Oh, yeah, that one...

Quill

that's not really spam though... it's just not "on-topic"

FR: Meetups.SO

Transcript for