amuck-landowner

LET Archive?

Mun

Never Forget
Is anyone archiving LET at this time, or keeping a running bot going to keep a concurrent copy do to all the deleted and vanishing threads?

Just out of curiosity.
 

drmike

100% Tier-1 Gogent
Is anyone archiving LET at this time, or keeping a running bot going to keep a concurrent copy do to all the deleted and vanishing threads?

Just out of curiosity.
Well, there are multiple things going on to accomplish such a thing.

Would require an initial mirroring of content.  Then it would require a later check of such content sort of frequently - maybe quarterly, arguably monthly.

Then you'd had to be scouring the page and noting key differences.

It's also a huge pile to ping regularly.  They have some very high IDs on stuff (although I can confirm they are padding numbers by at least 50% and a big heap of deleted IDs on all sorts of stuff).

If I started smacking them for all that data or anyone else, I'd expect some proactive blacklisting and such and a game of cat and mouse.

That said, I have something informally :)

If you are curious about something in particular, feel free to PM me details and I'll look into it.
 

k0nsl

Bad Goy
...plus, one must take into account that some of the content is only available to registrants/members.
 

kcaj

New Member
Well, there are multiple things going on to accomplish such a thing.

Would require an initial mirroring of content.  Then it would require a later check of such content sort of frequently - maybe quarterly, arguably monthly.

Then you'd had to be scouring the page and noting key differences.

It's also a huge pile to ping regularly.  They have some very high IDs on stuff (although I can confirm they are padding numbers by at least 50% and a big heap of deleted IDs on all sorts of stuff).

If I started smacking them for all that data or anyone else, I'd expect some proactive blacklisting and such and a game of cat and mouse.

That said, I have something informally :)

If you are curious about something in particular, feel free to PM me details and I'll look into it.
The site is behind CloudFlare so that would make it harder for them to detect a large amount of traffic from a single IP.
 

drmike

100% Tier-1 Gogent
The site is behind CloudFlare so that would make it harder for them to detect a large amount of traffic from a single IP.

CF is pretty nasty at least to level they have it configged in front of LE* currently.  I routinely get  a CF waiting screen where CF is doing/checking who knows what.

Pretty sure I've got CAPTCHA slapped too by CF.

Definitely would need to slow drip request pages to be a good netizen.
 

drmike

100% Tier-1 Gogent
Not worth drmikes time IMHO. LET is just a bunch of deadpoolers, scammers & drama all mixed into one pot.
Oh there are plenty of half flushed turds in that toilet over there.  Intelligence gathering doesn't necessarily mean watching smart people ;)
 

Mun

Never Forget
Oh there are plenty of half flushed turds in that toilet over there.  Intelligence gathering doesn't necessarily mean watching smart people ;)

I was thinking about it more because of the threads that constantly disappear.
 

kcaj

New Member
Definitely would need to slow drip request pages to be a good netizen.
I'm confident you wouldn't. I've used HTTrack previously to archive the whole of LEB and LET with a active connection limit of 100. Worked fine. Not sure how HTTrack handles updating existing copies or tracking changes.
 

drmike

100% Tier-1 Gogent
I'm confident you wouldn't. I've used HTTrack previously to archive the whole of LEB and LET with a active connection limit of 100. Worked fine. Not sure how HTTrack handles updating existing copies or tracking changes.
Bahahaha, you bad netizen.

Obviously, I like to exercise courtesy and stealth.  I don't want the cluster to melt and them to blame a DDoS on me.
 

DomainBop

Dormant VPSB Pathogen
Oh there are plenty of half flushed turds in that toilet over there.  Intelligence gathering doesn't necessarily mean watching smart people ;)
That statement should also be applied to WHT :p

Actual question asked by a provider who sells VPS and dedicated servers on WHT: "Does the T.O.S apply to users with VPS or Dedicated Servers? "If you provide VPS Hosting and/or Dedicated Servers, does your Terms of service and privacy policy and acceptable use policy and so on policies. Apply to those who purchase VPS or dedicated?"

I'm assuming he copied and pasted his TOS from a host in a box kit.

//end thread hijack

It's not worth the trouble. At the end of the day it's a forum that you guys invest too much time into. Archive other things that are actually worth archiving.
Agree
 

Wintereise

New Member
What surprises me the most is that despite being separate from the cesspool that is LowEndTalk, people here can't help but keep bringing it up.
 

drmike

100% Tier-1 Gogent
The reason why LET and LEB still remain slightly relative is because a good subset of folks no matter what has happened and been proven vile on those sites, still continues to be active over there.

It is also a distribution / PR site for new companies including some of those "cloud-wannabe" hosts.

And, it's a good place to discover new folks you will inevitably bump into, in the future, on the other more business-like sites.

An archive of LE* must include time in space multiple snapshots to show various naughty indicators, like their sink setting to make troubled posts just go away.

To me, LE* archive is to continue building pre-event intelligence and projecting what is going to happen at various companies.
 

mojeda

New Member
The site is behind CloudFlare so that would make it harder for them to detect a large amount of traffic from a single IP.
This is not exactly true, CloudFlare is able to proxypass your real IP to the site, however LET would need to have configured it both at server level and/or at the vanilla forum level (assuming vanilla has an option for that).
 
Last edited by a moderator:
Top
amuck-landowner