Thread #8844225
File: 1746676413544144.jpg (120.7 KB)
120.7 KB JPG
All are welcome to ask any questions or issues relating to Pixiv, the many Boorus, and Kemono Archive in this thread.
252 RepliesView Thread
Showing all 252 replies.>>
>>
>>
>>
>>
>>
>>
>>
>>8844517
The admin's abandoned ship months ago, anon. They aren't doin shit.
The sites on it's last legs, half of patreon can no longer be scraped because creators swapped to the new layout which Kemono can't read, the ones that haven't switched over no longer have text scraped when their stuff is imported which means links to fileshares no longer show up, and this week it seems fanbox updated their security because nothings been scraped from their site since the 11th.
>>
>>
>>
>>
File: 1742826773688293.png (866 KB)
866 KB PNG
>>8845774
Nothing changes?
>>
>>8845908
very weird, it's back to the usual now
I had a few filenames be something like: 1234567_1892u49817y49179241284f8123_p1
the stuff between both underscores was new, maybe it was either temporary or a browser glitch
>>
>>8845912
I saw it too for a while, there may be some A-B testing going on. It may be a content hash, because artists can reupload images (e.g. when flagged for insufficient censor), and they'd still have the same URL. With the content hash, different images would have distinct URLs.
>>
>>8845199
>Hire pajeets
>Pajeets do nothing but to hire other pajeets
>Reach a critical mass ang get a pajeet CEO
>Fire non pajeets employees to make more room for the pajeets
>Nothing work anymore and the company sink
>The pajeets are now applying for whichever company still exist
At this point, all the gafam are in an abbandon ship situation.
>>
>>8845660
It's quickly becoming nothing but a discord scraping site, which is hilarious, because folks on older browsers can't even view the content (all you get is errors), and discord itself is trying to sink it's own userbase with the identification crap.
>>
>>8845769
"Blocks" will always have workarounds unless you do some insane literal DRM
gallery-dl scrapes Fanbox and Patreon just fine. It breaks every now and then as sites make changes, but because the project is active and open source, they get fixed quickly. Kemono's problem is that it is both inactive and effectively closed source.
Sadly, most people are either too lazy or too retarded to use gallery-dl and upload themselves.
>>
File: 1762732651842277.jpg (3.5 MB)
3.5 MB JPG
Will there be sites like E-Hentai, ExHentai, Hitomi, Gelbooru, and Danbooru on Tor/I2P/Hyphanet/Zeronet/Lokinet/GNUnet and et cetera? I assume there are, at least mirrors, or whatnot. Hiddenbooru? But yeah, just need a backup plan in case Big Tech faggots kill the clearnet.
>>
>>
>>8846176
the vast majority of everyone are consumers
something like gallery-dl requires the user to be a subscripber/paid access to any services of note to actually pull down that content
sure you can scrape everything available from whatever service you sign up for but you still have the initial outlay of money, and that can get weird and sned up unwanted flags when you're talking about international currency transfers/exchanges or purchases
>>
>>
>>
>>
>>
>>
>>8845660
All of this wrong and you're a Redditor to no one's surprise. You need to commit suicide instead of suffering.
>>8844517
Only one person controls Kemono and he can't program. Initially, he said he didn't want to ban LLM slop because he's lazy. Then he said it'd discourage people from importing. Then he realized LLM slop increased ad revenue.
Fun fact, the last time the Kemono owner was last seen was last year in September or something. A month after that, the Patreon importer broke because Patreon changed the layout of the Patreon post and it hasn't been changed since then. Retards will say the Patreon importer broke down recently because they're too retarded to understand that creators had to opt in for the new layout and Patreon made it default recently.
>>
File: 1763146791298767.jpg (28.8 KB)
28.8 KB JPG
So where are Chinks getting DLsite/DMM/Fanza/Fantia/Fanbox/Patreon from?
Most of them on Exhentai are getting the files from other scrapers.
>>
>>8846372
Hello, newfag. You seem confused
>E-Hentai, ExHentai
Same site. Same server. Same owner. Same everything.
>Hitomi
Downscale mirror for Exhentai.
>Gelbooru, and Danbooru
Mirror for Xitter and Pixiv. They fuck with the files for some reason.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>8847831
>they deny it
>one of them claims to be the only Kemono importer
>they can't prove it
>until recently, they'd only upload after Kemono imported it
>no one spends over 500 USD in one month to download a few posts
>one of them mentions something about nekomoe, an euphemism for their new source
>you are a fucking retard
>>
>>
>>
>>
>>
>>
>>8848204
>Deviantart always had a ridiculous download limit.
There wasn't
I was able to scrape DA with both gallery-dl and WFDownloader, ever since that stupid update both programs conk out and shit errors after 10 images
Not all DA render autists/screenshotters allow manual downloads and some only insist on using DA's download button
>>
File: HOTD_Set_01_artkoikoi_51.jpg (668 KB)
668 KB JPG
>>8844517
I use kemono exclusively for AI slop.
It's getting to the point that most of my exhentai use is for AI slop, too.
You can complain that it's made by AI and that it's soulless and yadda yadda yadda but at the end of the day, it's the only way I'm getting hundreds of new images from shows that have been forgotten, in art styles that I like.
>>
File: be31a46d5e40bb809c1ea7d889bf8b95.jpg (291.8 KB)
291.8 KB JPG
Anyone know why the fuck I can't just click-drag to save images on Gelbooru anymore? Are they messing with the files now to not give me the full image?
>>
>>8845912
I thought that was my Gallery-DL having a stroke, but sounds like you're not even using that.
Either way it's clearly a hash of some kind, consisting only of letters a-f or whatever.
Though it does not appear to be MD5, CRC-32 or SHA1-512
>>
>>
>>
>>
>>
>>
>>8844678
That is just bullshit, I scrape Pixiv all the time. I don't know what tool Saucenao uses to scrape, but if Pixiv had blocked scrapers, they would have blocked my severely outdated version of Gallery-DL
>>8844550
Data increases at an absurd rate, and now that AI is a thing, it's a million times worse. But Saucenao most likely hasn't increased their processing capabilities to match it.
It takes quite a bit of processing power to process an image in order to be able to reverse search it, and then consider that they cover not just Pixiv, but basically everything.
If anyone wanted to make something that was 100x better for Pixiv where basically everything gets a result, even new stuff, it's not actually that hard to do, as long as you only focus on that and maybe one or two other sites.
The only downside is Pixiv is slow as fuck so it takes a lot of time if you're starting out or haven't downloaded in ages.
But this also depends on what you're searching. Are you searching with the full image? No problem
Searching with a cropped version? Well now they have to calculate a bunch of shit and store that which is 100x more computationally intensive, and AFAIK, Saucenao has never been good for cropped images so they probably didn't build with that in mind.
>>
>>
>>
File: 1764152419860154.png (48.1 KB)
48.1 KB PNG
>>8844225
newer stuff has been too dang slow desu
>>
>>8844225
the only problem i got with pixiv is that there is no way to pay privately on there. For fantia i can use Monero -> japanese gift card -> pay for Tora coins (internal currency) -> spend tora coins.
But Pixiv and pixivFanbox are quite restricted in their accepted payments. Haven't figured out a solid way to detach KYC. all guaranteed methods require either Japanese bank cards, phone number, physically be there (for convenience store cards) etc.
>>
>>
>>
>>8850128
Maybe explain what the fuck you mean by "don't work". Can't use anywhere? URLs you put in your browser, not many places to try them, wtf does it have to do with 4chan?
And Gelbooru's URLs? You mean the SITE isn't working? Fix your brain damage then ask the question again.
>>
>>8850132
Normally you can upload a file (png, jpg, gif) etc here directly from a site by posting the URL of a file, instead of selecting a file from your PC. This doesn't work with Gelbooru anymore. I tried other chans, like Capybarachan and this also doesn't work there anymore. I also can no longer use the URL to upload on ezgif.com and it will not even show an error. It will like I never uploaded anything in the first place.
>>
>>8850001
>But Pixiv and pixivFanbox are quite restricted in their accepted payments.
That's a shame. I was thinking of giving in and paying to see Tadd's new pages because I'm that desperate.
I guess I've to go back hoping for kemono to get fixed
>>
Are there any sites that aren't run by complete fucking retards? I can't make an account on gelbooru (registration is closed), danbooru uploads rely entirely on a group of pedantic fucking morons, rule34.xxx is also run by a group of mongoloids with no objective standards or rule enforcement. Meanwhile AI slop is infesting everything. What's the fucking solution here if you want to upload art?
>>
>>
>>
>>
File: 1761368015804474[1].png (2.5 MB)
2.5 MB PNG
>>8850430
>that's not a function of 4chan
I just posted a pic from another thread in /h/ using said pic's URL.
>>
>>
>>8850651
>>8850653
4chan literally does not embed URLs by default. If it does on your end, it's because you have something like 4ChanX installed.
So if something broke, it's an extension issue.
>I didn't add, remove, or change the settings of any around the time the problem started happening
Doesn't matter, shit breaks all the time whether you like it or not. Either from extension updating or 4chan changing something that requires extension to update.
>>8850522
Try again then, maybe you didn't set up DNS correctly. Or if your browser has it, use the built in free VPN if you're just doing light browsing on kemono, otherwise buy a VPS and set up a VPN on it for super cheap.
>>
>>
>>8850660
> it's because you have something like 4ChanX installed.
I don’t.
>>I didn't add, remove, or change the settings of any around the time the problem started happening
>Doesn't matter, shit breaks all the time whether you like it or not. Either from extension updating or 4chan changing something that requires extension to update.
…Read the rest of my previous reply.
>>
>>
>>8850709
4Chan literally does not allow you to upload by URL. If you were able to, it's due to an extension like 4ChanX. Vanilla 4chan experience only has an upload button that allows you to put an actual FILE that's on your clipboard or a FILE stored on your PC. Not an URL.
So yes, it IS because of an extension you have, which is now broken for Gelbooru.
>>
>>8850823
>If you were able to, it's due to an extension like 4ChanX.
Well, I am able to and I don't use 4ChanX or anything like that.
>Vanilla 4chan experience only has an upload button that allows you to put an actual FILE that's on your clipboard or a FILE stored on your PC.
>Not an URL.
Anon, it is through the upload button that I do it. if you click the upload button and instead of choosing a file from your PC you paste the URL of an appropriate online file, as if it’s a file name , you can post it, without the need of any extention. It is that simple.
>>
>>
>>
>>
>>
>>
>>
>>8851198
Use Gallery-DL, it's the only tool you need. I switched to that from PixivUtil2 a long ass time ago after getting tired of it constantly breaking, plus Gallery-DL works for MANY other sites too, so it's a very good multitool.
It's just a bit retarded to set up if you want it to keep the same naming scheme as PixivUtil2.
For Pixiv I have this in my gallery-dl.conf file
"pixiv": {
"metadata": true,
"filename": "{filename} - {title}.{extension}",
"directory": ["Downloads", "{user[name]} ({user[id]})"],
"postprocessors": [
{
"name": "metadata",
"mode": "json",
"base-directory": "Pixiv Metadata",
"directory": ["{user[name]} ({user[id]})"],
"filename": "{filename} - {title}.json"
}
]
}
Though I have it also download metadata into a separate folder as you see.
As for downloading the actual artists, I put a bunch of IDs into a "List.txt" and run a python script in the same folder as that like this:
import subprocess
def run_gallery_dl(command):
try:
subprocess.run(command, check=True)
except subprocess.CalledProcessError as e:
print(f"An error occurred: {e}")
def main():
input_file = "List.txt"
try:
with open(input_file, "r", encoding="utf-8") as file:
user_ids = [line.strip() for line in file if line.strip().isdigit()]
except FileNotFoundError:
print(f"File '{input_file}' not found.")
return
for user_id in user_ids:
url = f"https://www.pixiv.net/en/users/{user_id}"
print(f"Processing: {url}")
command = [
"gallery-dl.exe",
"-d", ".",
"--cookies", "cookies.txt",
"--download-archive", "PixivArchive.sqlite3",
url
]
run_gallery_dl(command)
if __name__ == "__main__":
main()
>>
>>8851198
>>8851395
Just remember to extract cookies with something like "Get cookies.txt (locally)" and put it in same folder as the script and name it "cookies.txt"
With that code it also creates an sqlite3 database, which makes it so it (hopefully) doesn't re-download something you've already downloaded, even if you for some reason rename or move the files.
I mainly use that script for the initial pull, if you want to pull once then later update your archive, just add into the commands "--abort", "3" so that if it finds the last 3 posts is something you already have, it skips the artist in the list.
You can use the script to download artworks too, just change the base URL of https://www.pixiv.net/en/users/ to https://www.pixiv.net/en/artworks/
I have scraped 20k or so artists this way and it works great.
Also if you ever run short on storage from scraping too much, consider using JXL in lossless mode to save roughly 50%, which you can use to archive twice as many artists.
Damn, 4chan really fucked up the spacing on the config file and the script...
Here's catbox with a sample gallery-dl config: https://files.catbox.moe/lildsp.txt
And here's the script: https://files.catbox.moe/es4mv8.py
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>8852591
Kemono's owner is a retard. There is no delay between each http request or file download. Multiple sessions are connected from the same IP address and user agent. So yeah, it's not hard for Fanbox to detect an account sharer.
>>
>>
>>
>>
>>8848729
I don't (just) hate AI slop because it's soulless garbage. I hate it because I know what good art looks like, and AI isn't doing it. I look at it and see all of the weirdly inhuman mistakes instantly now, because I've seen them so much. My standards are too high to put up with fucked up eyes, hair, fingers, lighting, etc. Honestly, your standards should be at least a little higher than they are.
>>
>>
>>
>>
File: file.png (1.4 MB)
1.4 MB PNG
>>8852949
Okay but how do you deal with the overabundance of completely garbage human-drawn art?
>eyes too close together
>weird, poorly traced "real life" quality
>asymmetrical nipples
>wide girl is wide on the cover but not in the actual story (inconsistent body type)
The double standard about your stance is what pisses me off. You've tolerated shit art for 20 years but now that a machine can spit it out quickly, you look for and home in on reasons to get irrationally upset about it.
>>
>>
>>
>>8853066
You're only assuming that I tolerate shit that humans draw too. I don't particularly. But here's the rub: even relatively lower quality human-made art tends to not have bleeding pupils, extra fingers, melting anatomy, and lack of pattern symmetry. Just bad execution. So the floor of tolerable art made by actual people is far more forgiving; it can look "worse" than AI art at the shortest glance, but still have less flaws when you stop to actually consider its qualities.
>>
>>
File: file.png (2.8 MB)
2.8 MB PNG
>>8853099
I'm not assuming that, but you certainly didn't cry about the entire medium of hentai over bad anatomy until AI became popular.
Look at this image. The thumbs, the nipples, the midriff... it's full of "anatomical issues" that, if it were AI, you would flip out over. The only reason you give it any grace at all is because it's older than AI - it's just "bad execution" instead of "an abomination and offense to all of art." You emphasize the good qualities of shitty human-made art while emphasizing the negative qualities of good AI-genned art. It's completely nonsensical.
>>
>>
>>8852949
>AI isn't doing it
Blame the retarded user behind it, not the tool.
What you're replying to is an image made by a slopper that spits out image after image non-stop to earn money from blind retards.
And like the other guy said, there's PLENTY of non AI art that looks like shit.
You're hating AI because it's the new cool thing to do.
Wake up and realize it's literally a TOOL. All it does is speed up the process significantly. If people had no understanding of human anatomy or how to use tools properly, they will spam out garbage.
Take someone who at least looks at their gen for more than 1 second and you'll see a massive jump in quality.
Like with non AI art, simply filter out the trash and you're good to go.
>>8853099
>But here's the rub: even relatively lower quality human-made art tends to not have bleeding pupils, extra fingers, melting anatomy, and lack of pattern symmetry
That would have worked, a year or two ago lol.
If you get those things with AI now, you're using a dogshit model like Pony, SDXL, SD1.5 or others.
Illustrious for example, if used properly, this is almost never the case.
If someone posts that shit in 2026, it's because of their own fault.
>human-made art tends to not have
It does, if you're a shitty artist or a toddler, just like using an outdated AI model.
Stop watching your local indian on twitter and think that's what AI is like just because they spam 100k images in a year.
>>8853258
Why is it always the retarded who hate on AI with no valid reason? Oh wait right, they're retarded, they can't use critical thinking lmao
>>8853109
Based poster who doesn't have room temp IQ
>>
File: GundamQUALITY.jpg (85.1 KB)
85.1 KB JPG
>>8853109
NTA but QUALITY is its own thing and was mocked at the time as well.
>>
File: 0167.jpg (399 KB)
399 KB JPG
>>8853316
Exactly my point, actually. Imagine if saying "all of anime is stupid and horseshit and fuckass quality" because of Gundam's disregard for robotic anatomy. Instead we laugh at QUALITY as a case by case thing, while being fair and impartial to the rest of the medium. AI deserves at least that treatment in terms of being accepted as "artwork."
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
File: photo_2025-08-09_02-48-22.png (570.8 KB)
570.8 KB PNG
>>8852591
Most likely they're now killing the accounts of whoever shared their cookie. It's over; at this rate, it'll be better to scrape each one from their own session.
>>
>>8854928
Go be a retard elsewhere.
The real yiffparty and Kemono revealed that 99% of uploaders don't know how to get the original files, gets the order wrong either purposefully or ignorantly, and deliberately uploads fake files.
And if anyone is making a Kemono alternative, keep LLM slop banned. Actually, ban commentary/reaction videos too. Or at least compress the shit out of their files so retards on Exhentai upload replaceable galleries so they can get banned by the system.
>>8854793
You're a Redditor which means you're insulting him because you're a retard who doesn't understand how Kemono works as you either believe everything on Kemono was imported by one person with infinite money or that Kemono uses a backdoor to get content behind paywalls for free.
>>
>>
>>
>>8854951
>The real yiffparty and Kemono revealed that 99% of uploaders don't know how to get the original files, gets the order wrong either purposefully or ignorantly, and deliberately uploads fake files.
I've long said that they need to have some browser extension to automate scraping with the session's proper IP.
>>8855029
I wouldn't hold my breath.
>>
>>
>>8855032
How ere they not doing something so basic? I can easily think of ways to try detecting some of that anyway if that was done, but there should have been some effort into making it not obvious if they were scraping so much.
>>
>>8855179
you'd still have to trust users not to fuck with the extension and make it pretend to scrape but instead upload CP, it's a highly non-trivial problem if the browser/scraper is not directly under your control
>>
>>8855184
It's a harder problem, but necessary. I don't think accepting anything without at least a couple of different users would be safe either. Tracking people based on very minor changes or times when a few get updated could narrow down the source when they would try to stop that, even if all users could be trusted.
>>
>>8851622
Yup, site is dead as fuck. They lost a legal battle with google early on and got delisted or something, their prospects of ad revenue funding their development never recovered after that so the entire project and it's future plans were scrapped. Owner isn't interested in it anymore, ad revenue sort of pays the hosting cost so they leave whatever is left running as is, as a courtesy to all the users. They don't interact or maintain it anymore, it's all dead and rotting code that barely works anymore. All it will take is one bad for the entire site to be wiped for good, shit is living on borrowed time.
It's really surprising no one else has stepped up and created another public booru service like that.
>>
>>
>>
>>8844225
Sankaku has been completely enshittified.
I don't know how you can fuck up a booru site like this,
The tag text size is too fucking big and the tags themselves are not even categorized anymore.
I used to use it for stuff not allowed in danbooru, but I can't bear to use it anymore. Takes fucking forever to load too.
I wish everyone was dedicated as the host of e-hentai. Despite bowing the knee to DMCAs, at least he maintains the site and it's functional without bullshit. The active community is a big plus as well. Only other comparable community is danbooru's. Only thing wrong with danbooru is the approval bullshit and blacklisted tags/artists.
The artist wikis on danbooru are super underrated.
>>
>>
>>
>>
>>
>>
>>
>>8855639
Both sites have the same owner.
>>8855631
No.
Schale is a paranoid bigot. He calls you a schizo and thinks you're stalking him whenever you say anything that he'll perceive as an attack. Someone asked on Reddit if Weebdex has the same owner as Niyaniya and Hdoujin, and Schale was pissed off by it and started calling him a schizo stalker. Schale hates interacting with people.
Before Kemono's owner disappeared, he'd meme a lot and sometimes answer some questions here and there while hinting at new updates and fixes on that imageboard. I never used the Telegram or Mossadtrix but I heard he interactsd with everyone there every day. Kemono's owner doesn't hide being a furry.
>>
>>
>>
>>
>>8856045
At least for fanbox, probably not a lot of people are going to be willing to pass out their session details after those letters. And making a throw-away account there are I think fewer payment options for new accounts.
>>
I don't understand why for now, even if it's "bothering", people who leaks stuffs on kemono don't just upload the stuffs on exhentai, until kemono is fixed. And same for the fanbox situation, if you can't upload by using cookies because you can be banned, just do manually on other sites.
>>
>>
>>
>>
>>8856045
Are you getting paid to shill or do you do it for free?
>>8856055
Kemono is finished. Detecting account sharing through session key alone isn't difficult.
Kemono isn't going to ask for your user agent and IP address because there's no security against MitM.
The only solution is to create a p2p torrent site and create a program that scrapes the subscription sites, creates a unique public ID of your subscription account, creates a torrent and uploads it. Anyone caught messing with the program to upload fake files or edited files gets banned.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>8857090
I've configured gdl to get any new/updated post that is missing on Kemono. If you're subscribed to any artist I like and you will share the files, I'll give you the configuration. I'll make it so it copies the files to a zip file that you can delete after uploading it.
>>
>>
>>
>>
Looks like Sankaku Complex (the booru) finished breaking. You'll always get a Search Timeout in mobile, the browsers won't load the front page, the searches won't work because you can only see one page and usually only what's on the favorites, and all videos show up with a length of 0:01 (but work fine).
Have there been any changes that prevent free users from accessible the booru? Any good altermatives or scrapers? Barring the excess of AI, it had the biggest library of anything porn wise.
>>
>>
>>
>>
>>
>>
>>8857801
Stop wasting time following people on a site, download instead and add to a list that you scrape every now and then.
What is the point of following? It doesn't preserve anything and just increases a useless counter. One day the account will be taken down and the art will be lost.
>>8857690
>Any good altermatives or scrapers?
Just use Gallery-DL on Sankaku and everything will be fine. I have no problems scraping artists with 10k+ results and I've scraped 4.82TB so far, though about 330GB are dupes I haven't bothered sorting out yet.
Just make sure you pass it username and password to log in.
If you want to build a serious archive you'd want it scraping metadata too. I can give you a simple script and config file for Gallery-DL that is great for downloading and it adds to a list so you can later run another script for updating your previously scraped tags.
>>
>>
>>
>>
File: [2025.03.08-21.21.03] AZrKGxj6Kr5.jpg (208.7 KB)
208.7 KB JPG
>>8858449
Because it contains valuable information about the files, most notably the tags. Unless you want to run some less accurate AI tagging model on everything yourself which is a waste of compute and time when the tags are already available.
But it also contains who the artist is, which AI taggers can't do, because the file itself doesn't hold that information, so scraping the metadata is important.
Of course the file downloads to the artist folder, but if there's more than one artist, that becomes troublesome.
It also contains the MD5 hash which is great for making sure you have a valid file, and it takes basically no time to scrape metadata and the space it takes is insignificant.
Out of my 4.82TB of files, the tags make up for 2.67GB, and you could 7z them to make that much smaller.
If you're a serious archivist, you'll store important information about the file.
Having the tags is also great for being able to search it locally if you make a setup for it like I've done with some of my other archives.
>>8858420
Here you go: https://mega.nz/folder/0soTzZZS#hRKqDFEJ8Q5mLx9ODW4SWw
There's an included readme if you're having issues with it.
All you need is python installed and added to PATH and edit the gallery-dl.conf with your username and password, but you can make a dummy account if you don't trust it.
You can also scrape without account, but you will miss a lot of posts.
Gallery-DL.exe is bundled with the scripts. If you don't trust it, you can grab the official exe from the github.
It saves filenames like this: [2025.03.08-21.21.03] AZrKGxj6Kr5.jpg which is based on upload date + the post ID and the metadata files are saved under the same naming scheme in a separate folder.
Enjoy scraping
>>
>>
>>8858506
You mean the comments people leave on the posts? Not with Gallery-DL to my knowledge.
You'd probably have to make your own scraper for that, shouldn't be too difficult if you use ChatGPT.
If you're having trouble setting it up, worst case you need to use PlayWright in a script to have an actual browser.
The most challenging part is probably setting up a way to find the URLs for every single post, unless you use it alongside my scraper which already has the IDs written down.
Here's a random JSON metadata file so you can see exactly what Gallery-DL stores: https://files.catbox.moe/a8kspc.json
It does however store information about how many comments there are, just not what they are and by whom.
Strangely enough it stores reaction information.
But comments and reactions are kinda useless because people can always comment on something, long after it's been posted, so if you wanted it to be accurate, you'd have to redownload it every time.
Downloading once is fine, will just take a very long time if it's for a lot of posts, but if you want to update it, it of course takes a lot more time and you have to make sure it checks if it's missing some comments, so it doesn't overwrite the entire file because it's different due to for example post itself being removed or the comments.
So it's a lot of trouble for something that IMO doesn't hold any real value.
On another note, I do kinda wish tags were stored a bit differently, as there's no indication in the JSON what type a tag is, like if it's an artist tag, general tag or whatever.
Would be so nice if Sankaku was like E621 and had a db export with all the tags, or just a database in general for all the posts, but no, sankaku has to be shit.
But it seems like there is some structure in the JSON, order seems to be franchises, studio, characters, artists, genres, fashions, anatomies and so on, so you can roughly guess what something is.
>>
>>8858697
Wtf are you even talking about? Enter once after every word? I break up my lines like how almost every other user does.
You on the other hand have double spacing, exactly how Reddit looks.
Either way, it doesn't make any difference, it's just a typing style. Grow up.
>What could go wrong clicking on a downloadable link
Simply clicking on it does nothing, you'd have to actually download it and run it.
Either way the script is extremely simple, if you can't read the code to determine that it's safe, you're genuinely retarded.
Biggest script is a mere 61 lines of code (33 if you exclude comments, spacings and print statements) and python is easily understandable if you know English, and if you still don't trust it, literally just feed it to ChatGPT to ask what the script does.
Go troll somewhere else shitposting faggot, claiming others are retarded while proving just how retarded you are lmao.
>>
>>8858603
>You mean the comments people leave on the posts?
What? No, I mean the text in the posts. That the artist writes. The description, I guess. Some artists write little fanfics to go with their art, I’d want to keep that too:
>>
>>
>>8858737
>retarded
I can at least read basic English to determine that 33 lines of code is safe :^)
>>8858743
I don't really know as I haven't looked into it, I guess you'll just have to try it on a post with a description to see, but I kinda doubt it.
I'd check it myself, but it's such a rare thing that I can't find it easily. But if you're patient and you know of a post, just give me link to it and I'll test tomorrow.
>>8858756
It's still quite rare, jannies just happened to do a good job for once today. It's very tempting to just never help anyone ever again on this site, just trolls everywhere.
4Chan was never the place for something serious, which is quite unfortunate. So much potential wasted.
>>
>>8858759
>It's very tempting to just never help anyone ever again on this site, just trolls everywhere.
It helps to think of the schizos and trolls as background noise. I think this is much easier on 4chan than elsewhere on the internet where they have to be more careful, where they get obliterated if they stand out too much.
>>
>>8858759
>It's very tempting to just never help anyone ever again on this site
fwiw i wish i'd had some pointers a few years ago when i got into scraping boorus and pixiv, it would have saved me a lot of time. even if i have no need for what you posted, it was still refreshing to see actual help being shared and code discussion happening, which is rarer and rarer these days. ignore the schizo, he broke out of his sadpanda containment thread and everyone knows who he is, including jannies. would not be shocked if i get a reply to this post calling me a retarded newfag that somehow devolves into yapping about reddit spacing and 2016 election tourists lmao
>>
>>
>>8858781
>background noise
Yeah except they're so damn noisy and always come back because the jannies don't do a good enough of a job.
4Chan should have a proper hardware ID ban or something to ensure people don't just switch IP to come back.
>>8858794
>fwiw i wish i'd had some pointers a few years ago when i got into scraping boorus and pixiv
Same, I started archiving relatively late, now there's a lot of posts that I might never be able to obtain.
But I wish I knew a lot of things sooner, like video encoding, because back a few years I ruined so many of my personal videos by compressing, not understanding how it all works and then discarding the original because I thought it was good, when it very clearly wasn't.
There should be a universal site that is well known that teaches people stuff like that and scraping and such and it's been very tempting to make it myself, but problem is that it wouldn't be well known.
I think we'd all be better off if more people understood how images and videos work aswell as how to scrape them and share it, at least the very basics of it. We'd have less hyper compressed material aswell as less posts purged to oblivion because nobody scraped it.
I wish there was a bigger effort into preserving art.
>>8858784
>>8858787
>>8858823
You keep crying out the words "retarded" and "slop" but you don't actually know what they mean. Take your meds.
>wasted mega.nz's storage
It pales in comparison to the wasted storage required for all your shitposts lmao.
>>
>>
>>
>>
>>
>>
>>
>>
>>
File: 307910be4ad04a789ea08cdf16da96f0.jpg (3.3 MB)
3.3 MB JPG
I see less people are uploading to them. How could it become more fun or useful to post in the boorus instead of xitter?
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
File: Mint.png (1.1 MB)
1.1 MB PNG
>been blocked from accessing Kemono for the past couple months
>managed to enjoy freely released shit
>notice I've missed 5 updates from deadbeat patreon
>finally crack and get a VPN for some poonany
>site goes down last night
I hate being retarded
>>
>>
>>
>>8850001
I was thinking the exact same thing.
basically, going from monero -> some clear coin -> pixiv? ive seen options online are basically either:
- bitcash/webmoney (play-asia.com, SEAGM, offgamers)
- v-preca (play-asia.com, SEAGM)
- local japanese convenience store card (impossible for me)
- loading a virtual prepaid Mastercard/Visa card (KYC restrictions make this difficult, dont know any concrete/confirmed routes)
as mentioned above, bitcash/webmoney/v-preca work on fantia and dlsite but pixiv and services like FANBOX are pretty restricted.
I'd appreciate any info. just anon trying to stay private out here
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>8861253
The devs haven't said a word for ages. Nothing's official. But unofficially, precisely because they haven't said a word for ages, probably. Or it could go down next week, or tomorrow, or today, who knows? But soon. Probably.
Save your shit. No, there is no rip of the whole site anywhere. IIRC that would be in the petabytes.
>>
>>8861253
The same thing literally happened last year. And the year before.
But yeah, one of these times it actually will die. Maybe not this time, maybe not next time, but if there's anything you'd hate to lose, save what you like and if you can upload it to the panda for safe-keeping. Well safe-ish.
>>
File: 1776267342863004.jpg (436.4 KB)
436.4 KB JPG
not 100% on topic but its relevant to yall:
apparently VISA doesnt like hypnosis content.
https://x.com/aiue_etizenn/status/2044054489938960460
https://x.com/zkurishi/status/2044186837972070646
>>
>>
>>
>>
>>
>>8860486
This is the culture where artists will delete their entire social media presence and then get mad at people reuploading their work.
It's not even really about corporatism. The guiding principle is "you had to be there".
>>
>>
>>
>>
>>
>>
>>8861339
Seeing Fakku getting a taste of their own medicine is probably the greatest gift in the world but it's not enough. Fakku must not be able to sell a single thing ever.
Also, take notes, newfags. Fakku claims to support artists despite choosing a payment processor over artists and causing the artist to lose sales by censoring their works overseas to prevent exposure.
>>
File: 003_3.jpg (2.8 MB)
2.8 MB JPG
>>8861472
When is the last time someone made a 250-page doujin/set about [that character you want to fap to] without using generative tools? Hell, let's bring it down to 25-images and ask the same question, though with only 25 images I imagine there would be an expectation of some level of "quality." What's the set? Is the character a current flavor-of the month, or a gacha girl, or is it some classic character? Are you man enough to post the link?
Some AI-fag named Remon made this one and I don't even know or like the character but goddamn, the titfuck is great.
>>
File: 00080-1772787374(2).jpg (306 KB)
306 KB JPG
>>8861706
People need to take the AI pill already. It was one thing when Pony was the only thing available, but nowadays you can make shit look like it's genuine art from the very artists themselves. Only reason to make AI-looking art is that you've come to enjoy the greasy 2.5D look. Pic related.
>>
File: 1756198363402201.jpg (508.6 KB)
508.6 KB JPG
>>8861742
Problem with AI is 99.5% of it is utter slop that fills up twitter/boorus because almost all users just set up A1111/ComfyUI and churn out novice garbage without understanding all the tools, settings, and prompting techniques. What you end up with is derivative slop because without controlnet to give you custom posing/angles with reference pictures even with proper prompting its hard to break out of the "mold" pose/camera angle-wise.
>Pic related
Here's what 2 minutes of using adetailer and inpainting can do. Take note of the fucked up hand and face smearing. If I wanted it perfect it'd take like 10-15 of tweaking shit. Would be closer to artist's style (linework on the blush/eye color etc.) if I had access to your prompt and the LORA associated with whoever that original artist is.
>>
>>
>>
>>
So like i have a few overly specific fetishes that i have trouble searching for. First is transformation loss. When a magical girl or someone with some sort of power loses those powers and becomes, well, powerless. Second is girls with secret identities having their identities exposed. Third is girls being forced to surrender to a weaker opponent because of a hostage or something. Problem is that these all don't have tags on most sites. I've been going around on exhentai, the boorus, kemono, pixiv all trying the kanji for these things, scanning all stuff i can find but its really not a lot. I don't even know where to look anymore. It could be that i already found all that there was to find since these are very specific things, but i also doubt it because sometimes i come across something entirely new that somehow escaped my notice
>>
>>
>>
>>8861974
Calm down my man, I agree but there's a reason why I posted that without fixing, and that is that you can just run that shit and get a result that is 90% of the way there, and then you just fix it up a little like you did and we're off to the races.
>>
File: 1769518593022169.jpg (161.4 KB)
161.4 KB JPG
>>8844225
why cant buy gold danbooru