Derpibooru has long been the center of image archiving for the My Little Pony fandom. But as recent events have shown, the owners and operators of that website are no longer interested in being an impartial image archive site, instead preferring to run an activist website for their own political biases. Large swathes of pony content face an uncertain future on that site or are effectively banned outright. The only way to guarantee that any site on the internet will impartially host content is to run it yourself. Thus, we made PonerPics.
Ponerpics.org is an image booru hosting pictures for the My Little Pony fandom with a particular emphasis on freedom for its users. Rules are minimal: the only existing rules are that images fall within legality, are relevant to ponies, and that no forum posts, comments or images are spammed. We're considering rules respecting the rights of artists and these may be added in the future. Ponerpics is a completely apolitical site. We do not care if your image expresses Nazism, Communism, Anarchism, sexuality of any kind, or if it expresses nothing at all – so long at it is pony. We merely host content for everyone. All legal content is permitted and there are no blanket bans or default filters for politics, Nazism, Communism, or OCs like Aryanne. For those who do not want to see certain content, like politics or fetishes, our site provides global filters to allow even logged-out users to browse as they please. This is a feature we intend to expand upon in the future.
Ponerpics is the combined effort of Atlas, Lotus, and Pupperwoff, the creators and administrators of mlpol.net, npfchan, and ASPNetChan. It is built upon the Philomena code developed by Derpibooru. Although the version you are seeing now is fairly early and is likely to encounter technical difficulties as it develops, we hope to improve the site over time and help it grow so that there may always be some corner of the internet where ponies may be posted freely.
>>274846 again I'm aware of that. Hence why I said derpi but with the excellent moderation style of mlpol. I'm just saying if nobody uses it it won't matter. I guess if it isn't going anywhere it will at least always be a reliable image dump
>>274651 Cry moar Niggel. >>274672 As far as errors go I've noticed that remote link fetching is entirely broken for both reverse search and uploading, which is a bit annoying but I'm guessing it's a similar thing to why it hasn't been re-implemented here either.
>>274909 Is there an existing archive of metadata that can be used to restore Commie-DNP content or should we be running around trying to get copies of it right now? I ask because the value of the DNP'd art right now is in the tags, rather than the images themselves (which are archived in multiple locations to my knowledge).
An unrelated site policy suggestion: in response to a DNP or copyright takedown, I suggest that the page, comments, and tags be left up, and only the image and thumbnails being replaced with a generic "image removed due to artist's request" image and thumbnail. This will comply with existing legal requirements, as the artist has no legal right to demand a takedown of the associated tags or comments, without disrupting the archival quality of tags and comments, and keeping more data around that you don't legally have to throw away can only be a good thing.
>>274923 No. Content is simply being uploaded faster than thumbnails can be generated, which is just what happens when you try to upload 1600 images an hour. Type in a tag, and you will see that the vast majority of content on the site has already generated thumbnails. The images in the first few pages are the most recently uploaded, and they will generate thumbnails soon.
>>274924 Somewhere, likely. However, if it is on derpibooru it can be mass uploaded now.
>>274925 This is not a bad idea, if images must be taken down for DNP. However, as I have access to legal researching tools, I think I will want to formulate my own opinion on the requirements of the DMCA before adopting a firm policy.
>>274924 Derpi's database dumps, pre-takedown, definitely contain all that. I grabbed a 28 June dump, which was before most of the anti-nazi takedowns came in. I am also certain there are tons of people who have older dumps, and/or might have even been scraping the website. Plus I don't know what's left in the database after takedown - the tags could still be there even then. Might be worth checking.
wow mlpol very impressive work, both this new gift of a fandom image site, as well as this entire board you've got running here had no idea you guys were skill chugging along long live ponies long live the milkmare of trottingham
>>274924 If you want to work on importing before they're gone from Derpi, I've attached a list of URLs to art by DNPd artists. As far I can tell the majority is still up at the moment due to the backlog of DNPs. This list was generated from a list of artists someone posted in the /mlp/ Derpi alternative thread. There are around 32k URLs inside.
>>274929 Derpibooru puts tags like "OP is a duck" and "drama bait" on art the leftists don't like. They don't enforce their rules against tag vandalization (calling someone a fag in the tags) against lefties so there are probably some spicy memes with those tags.
>>274968 >>274968 so basically this was fixed by derpibooru's latest code update, however we pulled code from before this. so as a result we're now trying to merge our changes with theirs, it'll take a few days but it's definitely doable. sorry for the inconvenience
Atlas; with all due respects, you might want to hold off on implementing this update until its clear this does not include sabotage to give faggots like byte a hidden backdoor key or includes general intentional performance decreases. Especially if this was uploaded after the lügenpresse articles. Remember who you are dealing with here. These kikes try to keep a quasi-monopoly together.
I've been reading the dumpsterfire thread that is Raptorshy posting on 4chan. Its like what the fuck. Are people really this bent out of shape about a fucking nazi pony? You'd think these people are literally trying to prevent the holocaust themselves the way they act. Atlas and you mods are the heroes we don't deserve. I was wrong to ever be skeptical about the severity of the situation.
>>275123 I might have to check the tags. The list of URLs i'm currently going through is the list of DNP artists someone posted a while back. I don't think login is the issue, the script uses the API key.
>>275127 Checking a couple images and it seems somebody else has beat me to it. Maybe they started on the list I posted. In any case it would seem things are working as intended. Guess I'll have to check the artist numbers at the end to see how well it went.
ponerpics has 32k pics right now, rainbooru has at most 24k pics the most recent post has that number and they definatly deleted a fair portion of all their pic . In only three days ponerpics is already much larger than it's natural competitor.
Three fucking days and we have more than out done a website that has existed for over 2 years.
I like the idea of creating a replacement for derpibooru or, at very least, a capable competitor. I could provide ~19k images, saved moslty from derpibooru, if you guys need more content. Just not sure how tagging works for mass uploads and how ponerpics handles duplicates (in case something that i have is already uploaded).
>>275198 We are looking into a means of uploading that bypasses thumbnail generation.
>>275301 Ponerpics has two methods for handling duplicates: a reverse search feature to check for a duplicate before you upload, and an automatic rejection of duplicate images after you've checked upload. We think that we've found a way to get a sufficient image inventory, but it's entirely possible that you have many images that were never on Derpibooru or otherwise missing.
>>275334 Both the email and the password must be exactly the same. When you get back to your original device, change the password and verify that what you think you typed in as your email is actually what you think it is.
PonerPics will be making some modifications to our servers and databases. PonerPics will go offline briefly today, and will be moved to a server with lower speed for what we estimate to be three or four days, after which we will move back to the operating server.
We ask that those doing mass, automated uploads of art from Derpibooru to PonerPics to stop now. It is no longer necessary, and may create problems when the databases are merged at the end of this period.
We are on the same server as before. You can upload to your heart's content. We are attempting to bypass the uploading process altogether by downloading the Derpibooru database, and if that succeeds then new uploads may be duplicates or erased altogether. Please keep uploading pictures that are not on Derpibooru, and mark them with special tags like "not on Derpibooru" so we can transfer them if we succeed.
i dont know if anyone is doing bulk loads; but i want to make a recommendation archiving the pictures of bronyworks. he creates real world military adaptions of mlp vectors. recently he created a lot of german soldier ponies and i fear he will soon get backlash for that.
>honour DNPs that aren't virtue signalled This will lead to poor enforcement and drama. Some cases are definitely clear-cut, but there will always be edge cases that will leave everyone angry. What if Dilarus submits a DNP despite never tweeting about ponerpics? He made a big stink about DNPing Ponybooru, and of course he's been virtue signalling nonstop about the Derpi situation; will that count or not? Now what if an artist is reasonable but uses Twitter as their main platform and, when they decide to DNP, just post a PSA to all their followers to inform them. Will you be able to judge that it's not "virtue signalling"? >honouring DNPs based on content That seems like a great way to scare people off drawing Aryanne. If someone is fine with not DNPing the policy won't be useful. If someone thinks they might like to DNP, then they're basically gonna either stew in indignation, or avoid drawing Aryanne outright, to avoid the risk of a potential DNP not being fully honoured. And people who have hardline ideological stances might get angry, even if they never intended to DNP.
So the choice seems to me to really be between accomodating artists, and being an archive. My personal advice would be to go a similar route to Ponybooru: honour DNPs, attract artists. But keep up the metadata of images taken down, and if possible let people make posts for DNPed artists that simply link back to the original source. (And ideally you could store the art on your servers for backup and archival, "just in case", but without displaying it on the website.)
I'm saying this because Ponybooru has flip-flopped a few times. They seem to be on the right track now, but Zizzy is Zizzy and who knows whether he'll just fuck up again one day. An alternative would be good. Meanwhile, we've got Rainbooru for archiving, and additionally Twifag has said that Twibooru will go up soon and will ALSO be focused on archiving. And mind you, neither Rainbooru nor Twibooru will honour DMCA notices, so if you want to be another archival-focused booru, "DMCA takedown only" already makes you strictly inferior to them, so you'd need to start by moving hosting to a copyright-lax country. I think it's best to have two of each, than three archive boorus and only one that caters to artists.
>>275704 A distinction could be drawn around the type of content and where it lies in the censorship crosshairs. An artist requesting a takedown of an Aryanne pic for example would get a haha archive go wrrrrrrr. Much of Anonfilly content falls in that category as well.
in case no one knows, both pillowfort and ponybooru are run by a former derpibooru executive formerly known as ZippySquirrel. A homosexual who performs autofelatio and used to sell pictures of his own junk on tumblr.
>>275810 Zippy is kinda based but yes he's a raging fag and (former?) furry. Not to be hated, but not to be trusted either. He's friends with Zizzy (because of course they would be) but doesn't "run" ponybooru. He's just one of several derpifags that zizzy's poached. What's his involvement in pillowfort now? I thought it was some kinda corporate cashgrab type of website, didn't expect a horsefucker faggot to be in there.
>>275832 I don't recall a socialist ever saying that to me, it's usually a conservacuck/liberal using horseshoe theory. Marxists tend to separate themselves from national socialism as much as possible. Zippy is being ridiculous though.
>>275826 >>275832 At the start of the "Furry Fandom" it really was just about liking cartoons with talking animals and anthro animals. The porn takeover happened over time, and it became seen as cringey to be a furry. So people saying "I'm a furry but I don't want to fuck Simba and Nala I just like their movie a lot" became less common. Normal people didn't want to be associated with an increasingly porn-obsessed leftist-injected insular circlejerk of an incestuous non-fandom. Furry is a nonsense word so liking a cartoon about dogs, a cartoon about anthropomorphic dog-men, wanting to fuck the dog-men and dogs, wanting to fuck real animals, wanting to wear the gay fursuits and thinking you are a reincarnated dog or dog on the inside, it's all something that makes you a furry. If the furry fandom agreed that liking air conditioning makes you a furry, and we also agreed so, it would be so. However fuck the person in that pic anyway. According to our modern definition, a furry is someone who wants to bone Sonic the Hedgehog. And we shouldn't give a shit how the furry fandom defines "their" term since it isn't their term any more. They've lost control over their group and how it's seen.
I feel this should be a topic of its own, as an interesting lens on how the "Fandom" tries to interject itself into everything. It remindes me of the LGBTQALPHEBETSOUP fandom. And yes, I did just call that a fandom.
The left, progressives, fuck it we all know there is no distinction of left and communism so that is what the fuck they are. They love fish net words, words so broad that they then call it a "Spectrum" (Which is an internet provider) What I mean by fishnet? Is that they try to increase their own numbers by redefining words so broad that they include everyone. This is no different that of communism and "EVERY ONE IS EQUAL" motif they spew around. And no matter what, because they ARE communists, they ARE political. So no matter which fandom they are apart of, somehow they interject themselves into that as well so they can then group the fandoms into one big clump.
Like BLM and LGBT blending together which really are two separate issues being painted in graphitty together, and then them trying and failing to do the same with Furry and MLP.
It is also amusing how they try to lump everything together but at the same time try to divide everyone that they just don't like or wants to be forced to accept their "inclusion", then they try to separate them out and have the "mob" either make them submit or they get rid of them, (like murder, reeducation, doxing, etc.)
I digress. I do find this a topic for another thread.
>>276142 You're right. Rich people can't become poor people without losing or giving up their money. But they can easily claim to be an "Oppwessed Minowity" like gay or bi, mudslime, tranny, nonbinary, etc. A rich black niggeress can get starving poor people on her side with a yell of "I'd be even richer if it wasn't for those fucking white males and their invisible racism!"
>>276487 Better yet, the Racism tag could be divided into who the racism is against. "Racism against whites", "Racism against blacks", "Racism against Ponies", There is no such thing as Racism against Jews because they're not human, "Racism against Zebras" for pics where Zebras aren't used as a metaphor for blacks and specifically mocked for shit only Ziggers do like rhyming and making potions, "Racism against all of humanity" for the misanthropic "ponies am superior humanity am inferior" trash seen in Conversion Bureau, and so on
>>276554 Why would it? Jews refer to a literal human race, while griffins are an allegorical race that is in no way legitimate, and any comparison is oth non-literal and subjective and hopefully not racist you racist.
>>276554 On second thought, maybe this was a dumb idea. I like the idea of specifically searching for anti-black art so I can laugh at racist jokes while filtering out the anti-white shit I'm sick of seeing But censorship-loving bastards would probably attack us over it.
>>277483 Would be nice to import the scores and stuff from Derpi. Would also be nice if votes from Derpi could be separated from votes on ponerpics. By that I mean a way to "turn off" Derpi votes. Not sure on the feasibility of it, but that would seem like a good solution.
>>277493 That's why I suggested having the ability to remove the Derpi votes. While they may be tainted, having votes at all helps to sort through things. Once there's a sizable number of PonerPics votes, could remove or possibly even treat it like a filter where the user can chose to include them or not.
>>277483 >so many people voting to import comments The fuck? Why would you want the retardation that is Derpi's comments? I get that sometimes they're useful and/or interesting, but a huge amount of comments are either useless (like a couple of people saying "nice" or "cute" - which is good feedback for the artist uploading their image, but have no purpose long-term) or just outright garbage, such as cringy quasi-RPers or "I wish that were me" or "omg so sexy" pajeet fantasies. You'd also be importing all of TUA's comments, for example - think about that.
>>277503 The problem is, the decision should be left to the individual user. Your position is agreeable on a personal level, but as a policy it gets trickier. Now whether moving over all the comments presents a labor burden on the site and therefore would be rightly omitted for time and resources, that's a different issue. But ommission 'because people said stupid' shit is a bad policy
>>277504 That's fair. They should definitely be separate, though, in that case, rather than imported directly as normal comments - maybe like an "archived comments" section, where you can read them, but it's under a different tab/hidden by default (potentially user-configurable). Among other things, it would make zero sense to have comments from a different website be displayed as part of the same "discussion" as on-site comments, when there's a very good chance most people who wrote the original comments will probably never ever see this new conversation or reply there.
>>277483 My argument against importing comments/votes is mainly just why? It just feels like completely copying derpibooru for no reason. To an extent, ponerpics has to be its own site, and not just a literal derpi clone with different rules. Sure, it make make sorting images by votes and such harder, but I think it'd be better this way. Plus seriously, who actually reads derpi comments?
>>277645 It does appear that uploads have overtaken thumbnail generation by a considerable margin. The hiding feature that twibooru uses does not work on our website. We will look further into it. At worst, this is a problem that can only persist until we switch to the new server in around two weeks, where all of the images will already be uploaded and have thumbnails. But we will look into solving this problem
>>277812 Yes, we know. At the very least clicking on “trending images” should result in mostly images that are not awaiting thumbnail generation, as will going towards pages much further on the catalog. Hopefully we can make it so that images not yet processed can be hidden. When we switch servers there will be no more delayed thumbnail generation as every image will already have thumbnails.
>>278052 The primary tag is "princess celestia." "Celestia" was not yet listed as an alias. The tag has been aliased, so typing in "celestia" should give you results for princess celestia now
>>278016 The legacy feature should allow you to sort by legacy score, legacy upvotes/downvotes, and legacy score, as well as search by those numbers. (We may change the name in the search bar to "derpi score" to make it more intuitive). We already have it working.
>>278214 No, that's right. A very large number of images were uploaded by a user. The user has since slowed down, but I estimate that the thumbnail generation is around 100k images behind, and will catch up in perhaps ~4 days or less. We've looked at ways to hide images that have not generated thumbnails, but have not yet succeeded.
For what it's worth, our second server is up to 740,000 thumbnails generated, with around 11 days until the full 2.1 million + are generated, and the legacy favorites/votes system works.
>>278452 If the site host fanfics, this feature could not be implemented before the server switch happens in ~9 days. It would take longer, and would likely look something like Furaffinity’s story hosting feature.
In the meantime, /mlpol/ has the ability to upload up to 5 documents or text files in a single post, and it may be advisable to start a thread on fan fiction preservation
Will the source be released at some point per AGPL3 requirements? The link in the footer still points to the derpibooru repo. Even if the code is largely unmodified, at the very least, files like config/footer.json have been touched.
>>278598 Are the old pun tags that Derpibooru got rid of going to be implemented, like Headlight Sparkle, Hootershy, and Rainboob Dash, or are they at least be used as alternate keywords when searching for the original tags like Derpi did when they changed them?
>>278758 The tags in the import have the tags that they had at the time they were scraped. This would be starting at about 2017. The tags, while already labeled as belonging to "characters" and so forth, don't come with aliases. We will likely have to separately download aliases from derpibooru, and I do not yet know how changes in tags over time between the older images and the current tag set will be handled. So if all of these tags are currently aliases on derpibooru, that's likely what they are going to be on ponerpics. If you want to make new, silly tags, go ahead. Just make sure they don't impede the functionality of tags and searching.
>>278760 How much time do you need for the whole import, Lotus? Just to have a reference for the complete setup. I am asking this because Ponybooru is already completing the gallery and Twibooru seems to be solving its thumbnails problem.
>>278792 10 days... I imagined that the completion would arrive at August 15 or 16 (at the end of the week) Well, no need to rush it but keep in mind that Derpibooru is announcing a possible deletion in bulk and I don't know when it will happen.
I am saying this because your site could fill that spot as soon as it happens for the incoming drama and only Ponybooru fills the community department so far. It would be appreciated and wise to stay there,latent, fully on guard and prepared for those moments of the possible disenchantment that could arise from the users. It seems redundant to say this but I've got to remind you that Rainbooru lost all its market space because it didn't fill the role properly and thus, Ponybooru gained that amount of success.
Again, I am not asking for any rushed process in the technical department but being prepared at the right time could determine which alternative does its best at taking advantage of those convulsed moments.
Anyway, thanks for the answer. Let's hope that this construction phase ends up nicely.
>>278804 We've been averaging about 120,000 thumbnails a day, which with 1.1 million images already having thumbnails, that leaves around about 9 days. The actual import - the copying of the files - can take much less time and if anything is proceeding more slowly because the thumbnail bottleneck provides little incentive to make it faster. It's also difficult to find servers with enough storage space to provide for not only the 2.6 Terrabytes of images and data in the database, but also the additional ~2 Terrabytes of thumbnails, and have some cushion for the event of a possible hard drive failure, and that are available for relatively cheap. If there were a certain server available for purchase that was available three weeks ago, I would have purchased another server so as to split the thumbnail generation between the two of them and halve the time. Hopefully most or all of the deleted images are in the archives, but we can do our scraping of Derpibooru for any images missing from the archives sooner.
>>278804 >>278811 I should mention the reason why we don't want to switch servers until most or all of the thumbnails are generated: we are using a bypass for thumbnail generation that is dangerous to use on a live website. Absent that bypass, maybe 25,000 to 35,000 thumbnails can be generated in a day.
>>278966 It will be able to host thumbnail processing, allowing thumbnails to process on both servers and be combined in the end. This should speed up the import. In the future I think we may also be able to import data there, have it process, and then be sent to the live server.
Mostly we just needed more storage space, so we bought another one to replace the smaller of our two back up servers. What makes this server different from the backup servers is that it actually has enough RAM to run philomena. So it can also be used as a test server in the future.
>>279711 Admittedly, image number 4 there is probably just a duplicate as there is a counterpart on Derpibooru. To compensate, here is another one among the tens of thousands that actually have been deleted.
Should the original uploader name and a link to the Derpibooru image be included in the description field in new imports? Also, if so, should it be above or below the original description? https://strawpoll.com/rx75fhqax
Ponerpics has completed it’s import of the archive – over 2150000 images, including 68,000 marked as deleted from derpibooru. However, this import only includes those images that were in the archive, and has a few gaps, like all of the images uploaded to derpibooru after July 8, 2020. We plan on filling all of those gaps with more imports in the near future, so the importation isn’t done. We also want to transfer a few key images from our old ponerpics server, but haven’t been able to yet. Maybe we can add those in the next few days, but maybe they will need to be uploaded again.
All of the imported images are tagged as “imported from derpibooru” and those deleted are marked as “deleted from derpibooru.” Images have their original image number from derpibooru, which means that links in the description work. They also have their original creation date and are sortable by that number. Ponerpics displays the derpibooru favorites, upvotes, downvotes, and score in parenthesis next to where these values normally appear. You can sort images by these values, and search with “derpi_upvotes” etc, and the same with combined scores. Tags have the same descriptions, images, and aliases as on derpibooru.
Not every piece of information was copied from the live ponerpics website because of limitations in testing ability and time. User avatars, moderation reports (including link and dnp requests), commissions, galleries, and private messages will have to be remade and reuploaded, as will all favorites, votes, and comments. Users who joined in the last few hours, after the information was transferred, will need to remake their accounts. Because of a discrepancy in how tags are numbered in the database, custom user filters will need to be remade.
You can still visit the current server at old.ponerpics.org until about August 30.
The import comes with some changes and updates, like a fix to file upload problems, and email password reset. We are missing a number of changes we would have liked to make, like new themes, fixing problems with the current default theme, mp4 support, and links to the derpibooru images below the source. We are hoping those can be added in the next few weeks.
Please tell us if there are any issues or if you have any requests for things you want us to try to transfer from the old server. We know there is an issue with svg uploads, and there are 6200 images that refuse to generate thumbnails. We hope to fix these issues quickly. The import set also includes many non-pony related and spam images that will need to be deleted. Please report these.
>>281150 There are a few images like that. Most likely, these are images where the metadata downloaded to the archive, but the image did not, so the page is missing the actual image. We intend to retrieve the missing images from Derpibooru
I’ve decided to re-open the website somewhat early. Many images are still waiting for their thumbnails to be transferred, while all other data and the images themselves have already been transferred. It will probably take a few days to finish the transfer of every thumbnail.
Reminder that you should avoid Derpibooru, or any altbooru. Text entered on the search fields, tags, or anything remains on the backend server (database) and are accessible by the admins. Even offline it's linked to your IP in the logs. (Query)
>>292014 Frenly reminder that Ponerpics.org is a sister-site to /mlpol/, created and developed by Pupper, Lotus, and Atlas, with the same considerations for user infosec and freedom that led to /mlpol/'s development. Your info is as safe there as it is here, which is as safe as can feasibly be.
It's sad that ponerpics is deserted. It would've been nice for people to regroup into a small community that likes occasional chit chats, events, celebrations. But instead it's just an archive for a sole purpose of archiving stuff.
here is an idea, being able to link a ponerpic pic here and it showing up instead of uploading said pic, you get what im saying? i think this would both diminish the amount of times pics have to be uploaded on mlpol while also giving access to the quite extensive(although taking a look myself there seems to be a few pics missing compared to other depiforks, for example just looking at the size of the loli tag) horse pussy trove to keep shills at bay and it could also make it so that the people here start being more active at ponerpics, for example uploading sum anonfilly pic to ponerpics an then posting it here, or something.
It seems that Derpi drama thread have slid down. So I'll ask here. Sorry if this is off topic. Some Anon on 4chan suggests that Derpi's policies and tools they use to trace users aren't GDPR compliant. >https://boards.4channel.org/mlp/thread/36373831#p36421378 AFAIK Derpibooru servers located in EU. Can someone, realistically, report them to some agency that's obligated to investigate GDPR violations?