Low Quality Posts HQ

12:11 AM

Phamhilator™ started (debug mode).

>>add-b-qt-lq ^([a-zA-Z0-9])(([\-.]|[_]+)?([a-zA-Z0-9]+))*(@){1}[a-z0-9]+[.]{1}(([a-z]{2,3})|(‌[a-z]{2,3}[.]{1}[a-z]{2,3}))$

Pham

Bad Tag Used: [web] | Advice on companies to build html from psd, by James, on stackoverflow.com.

Bad Tag Used: [website] | Redirect Website to HTTPS with limited retry?, by user3053105, on stackoverflow.com.

Phamhilator™ stopped.

Phamhilator™ started (debug mode).

Sam

>>info

Pham

Owners: Sam, Unihedron, Patrick Hofman, Jan Dvorak & ProgramFOX. Total terms: 949. Accuracy threshold: 17.5%. Full scan enabled: True. Posts caught over last 7 days: 0. Uptime: 00:00:14.4788282.

Sam

>>status

Pham

12:26 AM

Current status: Beta.

Sam

>>add-b-qt-lq ^([a-zA-Z0-9])(([\-.]|[_]+)?([a-zA-Z0-9]+))*(@){1}[a-z0-9]+[.]{1}(([a-z]{2,3})|(‌‌[a-z]{2,3}[.]{1}[a-z]{2,3}))$

Pham

ReDoS detected.

Sam

>>add-b-qt-lq (?i)testing regex|test|testing?.*

Pham

ReDoS detected.

Sam

>>add-b-qt-lq a

Pham

12:28 AM

@Sam Blacklist term added.

Sam

>>del-b-qt-lq a

Pham

@Sam Blacklist term removed.

Sam

>>add-b-qt-lq (?i)help meh|give meh teh code(z|s)

Pham

ReDoS detected.

Phamhilator™ started.

Sam

>>add-b-qt-lq (?i)help meh|give meh teh code(z|s)

Pham

12:37 AM

ReDoS detected.

Phamhilator™ stopped.

Phamhilator™ started (debug mode).

Sam

>>add-b-qt-lq (?i)help meh|give meh teh code(z|s)

Pham

@Sam Blacklist term added.

Sam

>>del-b-qt-lq (?i)help meh|give meh teh code(z|s)

Pham

@Sam Blacklist term removed.

Sam

>>add-b-qt-lq ^([a-zA-Z0-9])(([\-.]|[_]+)?([a-zA-Z0-9]+))*(@){1}[a-z0-9]+[.]{1}(([a-z]{2,3})|(‌‌‌[a-z]{2,3}[.]{1}[a-z]{2,3}))$

Pham

12:41 AM

ReDoS detected (term not added).

Sam

>>add-b-qt-lq (?i)testing regex|test|testing?.*

Pham

@Sam Blacklist term added.

Sam

>>del-b-qt-lq (?i)testing regex|test|testing?.*

Pham

@Sam Blacklist term removed.

Sam

>>add-b-qt-lq (.|.+|.*){20}[A-Z]

Pham

12:42 AM

ReDoS detected (term not added).

Sam

>add-b-qt-lq (a+)+

>>add-b-qt-lq (a+)+

Pham

@Sam Blacklist term added.

Sam

>>del-b-qt-lq (a+)+

Pham

@Sam Blacklist term removed.

Sam

>>add-b-qt-lq ^(([a-z])+.)+[A-Z]([a-z])+$

Pham

12:43 AM

@Sam Blacklist term added.

Sam

>>del-b-qt-lq ^(([a-z])+.)+[A-Z]([a-z])+$

Pham

@Sam Blacklist term removed.

Phamhilator™ stopped.

Zephyr

Flag Request -> Not an answer for stackoverflow.com/a/2879598/3041194 by cVplZ from Tavern on the Meta

Pham

Phamhilator™ started.

Sam

>>add-b-a-spam ^([a-zA-Z0-9])(([\-.]|[_]+)?([a-zA-Z0-9]+))*(@){1}[a-z0-9]+[.]{1}(([a-z]{2,3})|(‌‌‌‌[a-z]{2,3}[.]{1}[a-z]{2,3}))$

Pham

12:52 AM

ReDoS detected (term not added).

Phamhilator™ stopped.

Zephyr

3:53 AM

Close Vote Request for stackoverflow.com/q/14412833/792066 by Braiam from Tavern on the Meta

Close Vote Request for stackoverflow.com/q/18257220/792066 by Braiam from Tavern on the Meta

Zephyr

4:56 AM

Close Vote Request for stackoverflow.com/q/26685917/1577396 by Mr_Green from JavaScript

Zephyr

5:29 AM

Spam Flag Request for meta.stackexchange.com/questions/242903/… by cVplZ from Tavern on the Meta

Spam Flag Request for drupal.stackexchange.com/q/135558 by just a brick in the wall from Tavern on the Meta

Zephyr

6:21 AM

Spam Flag Request for meta.stackexchange.com/questions/242904/i-believe-the-research by Jan Dvorak from Tavern on the Meta

Spam Flag Request for meta.stackexchange.com/questions/242905/… by Jan Dvorak from Tavern on the Meta

Zephyr

6:40 AM

Spam Flag Request for meta.stackexchange.com/questions/242906/… by Jan Dvorak from Tavern on the Meta

Zephyr

6:52 AM

Spam Flag Request for drupal.stackexchange.com/questions/135562/… by Jan Dvorak from Tavern on the Meta

Close Vote Request for stackoverflow.com/q/26685087/1216976 by SomeKittens from JavaScript

Zephyr

7:30 AM

Close/Delete Request for stackoverflow.com/questions/26686973/… by TGMCians from Tavern on the Meta

Zephyr

8:26 AM

Close/Delete Request for stackoverflow.com/questions/26687445/… by Jan Dvorak from Tavern on the Meta

Pham

8:43 AM

Phamhilator™ started.

Sam

pokes @Uni

Pham

Phamhilator™ started (debug mode).

Sam

>>add-b-qb-spam ^([a-zA-Z0-9])(([\-.]|[_]+)?([a-zA-Z0-9]+))*(@){1}[a-z0-9]+[.]{1}(([a-z]{2,3})|(‌‌‌‌‌[a-z]{2,3}[.]{1}[a-z]{2,3}))$

Pham

ReDoS detected (term not added).

Sam

>>add-b-qt-off (.|.+|.*){20}[A-Z]

Pham

8:48 AM

ReDoS detected (term not added).

Sam

>>info

Pham

Owners: Sam, Unihedron, Patrick Hofman, Jan Dvorak & ProgramFOX. Total terms: 949. Accuracy threshold: 17.5%. Full scan enabled: True. Posts caught over last 7 days: 754. Uptime: 00:02:26.5793838.

Jan Dvorak

how does ReDoS detection work?

Sam

It's based on a primitive timeout system.

If it takes longer than 20ms to match, then it's considered to be flak.

Pham

Low Quality Q (33.3%): How to get another mobile network details in android, by J Bala Prakash, on android.stackexchange.com.

Sam

8:53 AM

The regex is matched against 6 different payloads (all 5K chars long). alpha + num + spec, alpha + num, alpha + spec, num + spec, alpha, num & spec.

Sam

9:08 AM

So far I've only added redos detection to the black term add commands. Still need to add it to the white add and all the editing commands...

Pham

Phamhilator™ stopped.

Unihedron

9:41 AM

@Sam Hiya! I was sleeping :p

Sam

Oh, sorry. Didn't mean to wake ya.

Since you probably know more Regex than anyone else here, I just wanted to have your opinion of the ReDoS mechanism (possible weaknesses, etc.).

Unihedron

No worries, about time anyway

@Sam Oh?

Sam

Yeah, I semi-implemented it last night.

Unihedron

They're mostly around Explosive Quantifiers, which always include X*X* when unfolded.

This includes:

[XY]*X*Z

.*X+ (because . includes X)

(.+)+ (which is .+.+ when unfolded)

(.X+)+ (which is .+X+X+ when unfolded, more dangerous than previous, since . includes X)

Sam

I see. So, I assume the payload has to be a continuous string of Xs, for those regexes to be effective?

Unihedron

9:55 AM

Yeah, if the unfolded regex includes a quantified duplicate group of the same subpattern, it's dangerous.

This includes (XY)*(XY)* as well, though the critical input will be harder to predict with a longer subpattern in substitute of X in X*X*.

Sam

Right, hmm. I'm just thinking, so would it actually be necessary to have redos protection in the first place then? Since all the strings Pham checks ~~never~~ very, very, very rarely consist of a single continuous series of chars.

Jan Dvorak

regexes like (.*)*x$ are slow for any input.

Unihedron

No, it may not be necessary, but for X in X*X*, it can be any subpattern, which includes being any character.

Sam

Ah, true, true.

Unihedron

And (XY)*(XY)* can be ([a-z] )*([a-z] ){1,50}, which is even harder to detect.

Actually, detecting explosive quantifiers are very difficult. Github can't do it, so you have to grep binary data on the repository on a local machine yourself.

Google docs can't do it.

Jan Dvorak

10:02 AM

can't we just assume the regex writers ~~aren't dicks~~ ~~aren't stupid~~ know what they're doing?

Sam

"detect" as in unfolding?

Unihedron

@Sam Even if you manage to go through the algorithm to unfold a regex, understanding the pattern is not as simple. Because then you will also have X*XX*, or X*[XY]*Y*, which are all derivatives of `X*X*``.

Sam

@Unihedron But Pham doesn't unfold anything...

1 hour ago, by Sam

If it takes longer than 20ms to match, then it's considered to be flak.

Unihedron

@Sam That's probably a good approach, but is the test string hardcoded?

Sam

Yes, there are actually 6 different test strings (with varying cardinalities).

Unihedron

10:06 AM

Are they on the public repository? I could try writing one write now.

Sam

Yes, they are. But each test string is 5K chars long...

looks for the file

Unihedron

>>add-b-qb-spam (h+(ealth+)?)+.h+

Sam

Lemme start Pham...

Unihedron

Ok!

Sam

Here's the file (the strings are near the bottom).

Pham

10:09 AM

Phamhilator™ started.

Unihedron

Lol I like that.

>>add-b-qb-spam (h+(ealth+)?)+.h+

Pham

@Unihedron Blacklist term added.

Unihedron

Ohh, it passed.

Sam

Maybe I should lower the limit...

Pham

Command not recognised.

@Unihedron Blacklist term removed.

Unihedron

10:11 AM

>>add-b-qb-spam \w+.(\d.{2}\w)+

Pham

ReDoS detected (term not added).

Unihedron

Yeah, the test strings are great.

Sam

:D

@Pham fp why

Pham

@Sam Blacklisted term(s) found: 9364.7]$d+

Sam

Darn scores gone haywire again.

Jan Dvorak

10:21 AM

it also failed to escape the backslash in \$

is that score a display bug? It doesn't really look like a display bug.

Sam

No, it isn't. I've noticed this bug before, and tried to patch it (which seemed to work). I'll work on it asap after I've finished refactoring the command processor...

I'm still not quite sure where it's getting these massive numbers from. Since newly added terms are set to the average score for that specific filter...

Jan Dvorak

I'll file an issue concerning that hidden backslash today if you don't

Pham

Low Quality Q (100%): Baking Double Pans of Muffins, by Candy, on cooking.stackexchange.com.

Sam

I'll let you do it, busy coding atm ;)

Jan Dvorak

g2g now, sorry

Unihedron

10:27 AM

See you!

Sam

Np, cya!

Pham

Phamhilator™ stopped.

Sam

There, added redos protection to all commands.

Pham

Phamhilator™ started.

Sam

>>pause

Pham

10:39 AM

Phamhilator™ paused.

Sam

>>add-b-qt-lq test

Pham

@Sam Blacklist term added.

Sam

>>del-b-qt-lq test

Pham

@Sam Blacklist term removed.

Phamhilator™ started (debug mode).

Sam

>>pause

Pham

10:42 AM

Phamhilator™ paused.

Sam

>>add-b-qt-lq test

Pham

@Sam Blacklist term added.

Sam

>>edit-b-qt-lq test¬¬¬\w+.(\d.{2}\w)+

Pham

ReDoS detected (term not updated).

Sam

>>del-b-qt-lq test

Pham

10:43 AM

@Sam Blacklist term removed.

Sam

>>add-w-qt-lq stackoverflow.com test

Pham

@Sam Whitelist term added.

Sam

>>edit-w-qt-lq stackoverflow.com test¬¬¬\w+.(\d.{2}\w)+

Pham

ReDoS detected (term not updated).

Sam

>>del-w-qt-lq stackoverflow.com test

Pham

10:45 AM

Whitelist term does not exist.

Zephyr

Close Vote Request for stackoverflow.com/questions/26685740/… by hakre from PHP

Sam

I think I know what's causing the score bug.

The term's score 9364.7 should be 9.3647 (I think), but when Pat ran Pham (and when all the terms/scores were read during startup) there must've been some sort of culture diff therefore resulting in an incorrect decimal reading.

Although, that doesn't explain why that's the only term with an abnormal score.

Sam

11:03 AM

Yep, just as I thought (culture issues). Bug fixed.

Pham

Phamhilator™ started.

Sam

>>add-b-qt-lq test

Pham

@Sam Blacklist term added.

Low Quality Q (65.7%): A strange dream, by neckTwi, on cstheory.stackexchange.com.

Sam

@Pham tpa

@Pham why

Pham

@Sam Blacklisted term(s) found: 23]^(?i).{0,18}$

Sam

11:16 AM

@JanDvorak It's a display bug (the post wouldn't have been caught if it weren't escaped). I can also see in the terms files that the actual term is \$\d+.

>>add-b-qt-lq test\\

Pham

Low Quality Q (33.3%): what are the number of swaps required in selection sort for each case?, by user3126632, on stackoverflow.com.

@Sam Blacklist term added.

Low Quality Q (60%): LOOKING FOR NAME OF AN ANMIE, by James, on anime.stackexchange.com.

Sam

>>edit-b-qt-lq test\\¬¬¬ \w\w

Pham

@Sam Term updated.

Low Quality Q (23.6%): Update Drupal core to 7.32 showing error related datex, by Amir Hossein Akbari, on drupal.stackexchange.com.

Sam

@Pham why

Pham

@Sam Blacklisted term(s) found: 22](?i)error(s)? 13.3] ww Whitelisted term(s) found: 10.5](?i)error(s)?

Low Quality Q (38%): Staircase method with unequal step sizes, by Chris Stronks, on cogsci.stackexchange.com.

Sam

11:20 AM

>>del-b-qt-lq \w\w

Pham

Spam Q (90.9%): Tips for Building Muscle fhgfj, by user274595, on meta.stackexchange.com.

Blacklist term does not exist.

Sam

>>del-b-qt-lq \w\w

Pham

Blacklist term does not exist.

Zephyr

Spam Flag Request for meta.stackexchange.com/questions/242915/… by cVplZ from Tavern on the Meta

Sam

Oh, chat auto removes multiple spaces facepalm

@Pham tp

Pham

11:21 AM

@Sam TP acknowledged.

Phamhilator™ stopped.

Phamhilator™ started.

Low Quality Q (62.9%): Recieving Error Code 60 connecting iCal to OS X Server, by Smart Shovon, on apple.stackexchange.com.

Sam

>>add-b-qt-lq \s\w\w\s

Pham

@Sam Blacklist term added.

Low Quality Q (38%): Override img class in gallery, by fefe, on wordpress.stackexchange.com.

Sam

>>del-b-qt-lq \s\w\w\s

Pham

@Sam Blacklist term removed.

Sam

@Pham why

Pham

11:27 AM

@Sam Blacklisted term(s) found: 13.3]swws

Sam

Hmm...

Pham

Low Quality Q (33.3%): how to do automated plugin updates on a highly secured server ß, by zero, on wordpress.stackexchange.com.

Sam

@Pham tpa

Pham

Low Quality Q (100%): Driving in the US but lost licence, by Jill Whittele, on travel.stackexchange.com.

Phamhilator™ stopped.

Phamhilator™ started.

Sam

>>add-b-qt-lq \s\w\w\s

Zephyr

11:33 AM

Close Vote Request for stackoverflow.com/questions/26678133/… by mikedidthis from HTML / CSS / WebDesign

Pham

Phamhilator™ started (debug mode).

Zephyr

Close Vote Request for stackoverflow.com/questions/26688044/… by mikedidthis from HTML / CSS / WebDesign

Pham

Phamhilator™ started.

Sam

>>del-b-qt-lq test

Pham

@Sam Blacklist term removed.

Sam

11:36 AM

>>add-b-qt-lq \s\w\w\s

Pham

@Sam Blacklist term added.

Low Quality Q (38%): Initializing in arima.sim in R, by kris91, on stats.stackexchange.com.

Low Quality Q (38%): Numbre of cluster in PPS sampling method, by houneida, on stats.stackexchange.com.

Sam

>>del-b-qt-lq \s\w\w\s

Pham

Low Quality Q (38%): rate module thumbs up / down widget with button, by Rahul Baisane, on drupal.stackexchange.com.

Low Quality Q (38%): What are the mechanisms at work in a pull-up or pull-down resistor circuits with a push-buttons and a GPIO?, by APerson, on electronics.stackexchange.com.

Low Quality Q (38%): Logistic Regression using fractional polynomials in R, by Dan Fountain, on stats.stackexchange.com.

Sam

>> del-b-qt-lq \s\w\w\s

Pham

Low Quality Q (40%): Understand the date structure - how the date is structured, by prgos, on programmers.stackexchange.com.

Blacklist term does not exist.

Sam

11:37 AM

>>pause

@Pham why

Pham

@Sam Blacklisted term(s) found: 13.3]\s\w\w\s

Sam

@JanDvorak No need now, I've fixed it ^

Zephyr

Close Vote Request for stackoverflow.com/questions/26661900/… by hakre from PHP

Zephyr

1:02 PM

Flag Request -> Not an answer for stackoverflow.com/a/26689424/3622940 by Unihedron from Tavern on the Meta

Zephyr

1:17 PM

Close Vote Request for stackoverflow.com/questions/26689648/… by Jon Clements from Python

Pham

1:41 PM

Phamhilator™ started.

Sam

>>info

Pham

Owners: Sam, Unihedron, Patrick Hofman, Jan Dvorak & ProgramFOX. Total terms: 950. Accuracy threshold: 17.5%. Full scan enabled: True. Posts caught over last 7 days: 774. Uptime: 00:01:00.4314565.

Low Quality Q (60%): Какие значения имеет слово “фигачь”?, by user4384, on russian.stackexchange.com.

Sam

>>pause

Zephyr

2:02 PM

Close Vote Request for stackoverflow.com/questions/26690004/… by Martijn Pieters from Python

Zephyr

2:21 PM

Close Vote Request for stackoverflow.com/questions/26690136/… by Martijn Pieters from Python

Zephyr

3:01 PM

Spam Flag Request for meta.stackexchange.com/questions/242920/… by rene from Tavern on the Meta

Pham

5:20 PM

Phamhilator™ started.

Low Quality Q (37.1%): I want to run CAT6 cabling to my house and I have never done this before, by jmluther, on serverfault.com.

Pham

5:32 PM

Phamhilator™ stopped.

Zephyr

6:01 PM

Close Vote Request for stackoverflow.com/q/26632090/3622940 by Unihedron from Tavern on the Meta

Zephyr

7:17 PM

Delete Vote Request for stackoverflow.com/q/26691320/508666 by PeeHaa from PHP

Zephyr

7:32 PM

Close Vote Request for stackoverflow.com/questions/26692235/… by TGMCians from SO Close Vote Reviewers

Zephyr

7:59 PM

Close Vote Request for stackoverflow.com/questions/26690770/… by user245167 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26692537/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26692723/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26692682/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26692739/… by TGMCians from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26692838/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26675448/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26665587/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26648247/… by hichris123 from Tavern on the Meta

Sam

9:02 PM

in Tavern on the Meta, 41 secs ago, by Ahmad

They didn't mean that, we had a very nice chat yesterday, we all enjoyed it

double-facepalm

Zephyr

Close Vote Request for stackoverflow.com/questions/26693180/… by hichris123 from Tavern on the Meta

Zephyr

9:51 PM

Close Vote Request for stackoverflow.com/questions/26693603/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26693304/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26673569/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26443991/… by hichris123 from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/25185726/… by hichris123 from Tavern on the Meta

Zephyr

10:09 PM

Close Vote Request for stackoverflow.com/questions/26693637/… by PeeHaa from PHP

Close Vote Request for stackoverflow.com/questions/26693637/… by Frank from Tavern on the Meta

Close Vote Request for stackoverflow.com/questions/26693753/… by PeeHaa from PHP

Close Vote Request for stackoverflow.com/questions/26693637/… by PeeHaa from HTML / CSS / WebDesign

Pham

Phamhilator™ started.

Sam

10:24 PM

>>info

Pham

Owners: Sam, Unihedron, Patrick Hofman, Jan Dvorak & ProgramFOX. Total terms: 950. Accuracy threshold: 17.5%. Full scan enabled: True. Posts caught over last 7 days: 0. Uptime: 00:00:59.7884198.

Sam

>>status

Pham

Current status: Beta.

Sam

>>not-real-command

Pham

Command not recognised.

Sam

10:25 PM

Good...

>>help

Pham

See here for a full list of commands.

Sam

>>ban user 236340

Pham

User banned.

Sam

@bjb do you have priv command access?

Pham

Low Quality Q (17.9%): Icon problem on iPad Air, by pacoverflow, on apple.stackexchange.com.

Low Quality Q (100%): Can I drive a van in Australia on my UK full driving licence?, by Faiz Khan, on travel.stackexchange.com.

Low Quality Q (100% FSF): Help with IQ Balance equations?, by Tom, on dsp.stackexchange.com.

Zephyr

10:35 PM

Flag Request -> Very Low Quality for stackoverflow.com/a/26693921/1699210 by bummi from The SO Tavern (Free Snacks)

Zephyr

10:47 PM

Spam Flag Request for stackoverflow.com/questions/26689910/… by hichris123 from Tavern on the Meta

Spam Flag Request for stackoverflow.com/a/26693372/2581872 by hichris123 from Tavern on the Meta

Spam Flag Request for stackoverflow.com/a/26636176/2581872 by hichris123 from Tavern on the Meta

Spam Flag Request for stackoverflow.com/questions/26619389/… by hichris123 from Tavern on the Meta

Close/Delete Request for superuser.com/questions/834776/… by Jan Dvorak from Tavern on the Meta

bjb568

11:33 PM

@Sam Not that I'm aware of.

Sam

K, I'll add ya.

bjb568

>>help

Sam

He's not running atm, just a sec...

bjb568

...

Pham

Phamhilator™ started.

Sam

11:35 PM

>>pause

Pham

Phamhilator™ paused.

>>add user 237813

User added.

>>help

See here for a full list of commands.

Sam

11:36 PM

@bjb there ^

bjb568

11:54 PM

>>help

Pham

See here for a full list of commands.

bjb568

\o/

Sam

>>info

Pham

Owners: Sam, Unihedron, Patrick Hofman, Jan Dvorak & ProgramFOX. Total terms: 950. Accuracy threshold: 17.5%. Full scan enabled: True. Posts caught over last 7 days: 0. Uptime: 00:21:05.0803584.

Sam

50 terms to 1K :D

Transcript for

Low Quality Posts HQ