Reddit scraper API for posts and comments
Send a public Reddit URL to the Crawl endpoint and get back structured Markdown — posts with comment threads, subreddit listings, and user activity feeds. No Reddit account or OAuth app needed.
Endpoint — bashPOST https://api.search1api.com/crawl{ "url": "https://www.reddit.com/r/programming/" }
Each public URL type maps to a dedicated feed path — clean Markdown plus structured metadata.
Post body plus the comment thread — each comment with author and date.
Current listing as structured entries; sorted and time-windowed views carry over.
The public activity feed of an account — posts and comments in order.
Useful for
Social listening / AI training data / Community research
What goes in, what comes back
Three URL types. Left: the public page as Reddit actually serves it to anonymous visitors — a real capture through the same egress the crawler uses. Right: the complete results.content the API returns, byte for byte.
reddit.com/r/askmath/comments/16womvs/What Reddit serves

722 KB of HTML — signup rail, related posts, ad slots
What the API returns
markdown/u/RomanBlue_ · 2023-10-01I don't know if this type of post is allowed, but I have a problem I've been wrangling with. I am building a tool for visualizing player statistics for a certain game, and I am only given a few stats to work with.Say a person has played a video-game for a while - The matches can either end in a win, lose, or draw, and the person can either survive or not survive the match, which is separate from whether they won, lost or drew.Say you know the total amount of video-game matches a person as played, as well as the total number of matches they won, the total number of matches they lost, the number of matches they won and survived, as well as the number of matches they survived in total.Is there any way to find out the total matches this player had a draw, as well as the number of draws he has survived? If not, why?My conclusion is that this is impossible, because you would have to know the amount of matches they lost and survived, which you cannot with the information given. At least I think? Would appreciate some help :)## Comments (3)### /u/ArchaicLlama · 2023-10-01You have enough information to calculate the number of matches lost. You do not have enough information to calculate the number of lost matches that were survived.### /u/TheShirou97 · 2023-10-01The total number of matches where they had a draw is easy: it's the total number of matches overall, minus the total wins and losses.However the number of matches where they had a draw and survived is indeed impossible.SurvivedDidn't surviveTotalWinGivenCan be inferred (=total wins minus survived wins)GivenDrawCan't be inferredCan't be inferredCan be inferred (=total minus wins and losses)LossCan't be inferredCan't be inferredGivenTotalGivenCan be inferred (=total minus survived)GivenNote that you'd need only one of the four missing stats to infer the other three but otherwise it's impossible. (Indeed there are 6 degrees of freedom in the table above, one for each individual case. But you are only given 5 numbers, so it's impossible to get everything)### /u/RomanBlue_ · 2023-10-01Okay, that checks out with what I got. Thanks a ton for the reply and putting it in such a clear way :)
Post body + comment thread — 2.3 KB · feedType: "post"
reddit.com/r/programmingWhat Reddit serves

987 KB of HTML — vote buttons, flair, sidebar modules
What the API returns
markdown## [Announcement: We've Updated The Rules, and April Is Finally Over](https://www.reddit.com/r/programming/comments/1tlh5aj/announcement_weve_updated_the_rules_and_april_is/)/u/ChemicalRascal · 2026-05-23After [temporarily banning LLM-related content over April](https://www.reddit.com/r/programming/comments/1s9jkzi/announcement_temporary_llm_content_ban/), and [asking you for feedback on that ban](https://www.reddit.com/r/programming/comments/1t4odyl/looking_for_feedback_on_ai_content_in/), we've decided to bring about an end of the temporary, I-can't-believe-it's-still-April ban on AI-related posts.Replacing the trial rule is a new shiny rule that refers to our new shiny [AI policy](https://www.reddit.com/r/programming/wiki/ai-policy/). In short:> Content about AI and LLMs are considered off-topic with the sole exclusion of **deeply technical** content about implementation.And if you want more detail than that, go read the policy, that's what it's there for.In addition, when writing that rule, I realized the rules weren't listed on the [old.reddit.com](http://old.reddit.com) sidebar, so that's been updated. For those of you who are seeing those rules for the first time, everything there is not new. We've been enforcing those rules as best we can for ages. You can click the link above those to get to the old.reddit rules page, with plenty of info that doesn't exactly read well when crammed into a sidebar.## [Your Compiler Can Undo Your Security Checks](https://www.reddit.com/r/programming/comments/1wdwqje/your_compiler_can_undo_your_security_checks/)/u/esiy0676 · 2026-09-11## [GCC 13.5 released with 265+ bug fixes](https://www.reddit.com/r/programming/comments/1wdiygn/gcc_135_released_with_265_bug_fixes/)/u/Fcking_Chuck · 2026-09-11## [Shopify is moving from React Native back to Swift and Kotlin](https://www.reddit.com/r/programming/comments/1wd7wmu/shopify_is_moving_from_react_native_back_to_swift/)/u/soap94 · 2026-09-11## [Rune is now open source](https://www.reddit.com/r/programming/comments/1wdjvd3/rune_is_now_open_source/)/u/ernestrc · 2026-09-11## [Hand-Coded ASM Powers Homebrew SNES Game](https://www.reddit.com/r/programming/comments/1we8i2v/handcoded_asm_powers_homebrew_snes_game/)/u/r_retrohacking_mod2 · 2026-09-12## [Why I Don’t Publish Technical Articles Anymore](https://www.reddit.com/r/programming/comments/1wdjn6m/why_i_dont_publish_technical_articles_anymore/)/u/galratner · 2026-09-11## [How to Write an Effective Software Design Document](https://www.reddit.com/r/programming/comments/1wd1jt9/how_to_write_an_effective_software_design_document/)/u/fagnerbrack · 2026-09-11## [Commander Keen's Adaptive Tile Refresh](https://www.reddit.com/r/programming/comments/1wd9hp8/commander_keens_adaptive_tile_refresh/)/u/lelanthran · 2026-09-11## [How do you keep decentralized data consistent without a central server?](https://www.reddit.com/r/programming/comments/1wegjbc/how_do_you_keep_decentralized_data_consistent/)/u/sanity · 2026-09-12## [EU Cyber Resilience Act reporting obligations started today. Is your company even thinking about it?](https://www.reddit.com/r/programming/comments/1wds2fy/eu_cyber_resilience_act_reporting_obligations/)/u/Maria_3464 · 2026-09-11As of today, a manufacturer who puts software or hardware on the EU market under its own name is obliged to report actively exploited vulnerabilities and severe security incidents.Here is a quick explainer if you want the details: [https://youtu.be/IQkzg7quc58](https://youtu.be/IQkzg7quc58)There is quite a lot of ambiguity over CRA and how it's going to apply to open source. Regulations keep changing. The line between a commercial manufacturer and an OSS steward is blurry, as well as the terms used in the regulations.But genuinely curious. Is your company aware of CRA? Is there any talk about it, or is it just not on the radar yet?## [Inside Claude's Android app: Finding the Internal Settings](https://www.reddit.com/r/programming/comments/1wdklfz/inside_claudes_android_app_finding_the_internal/)/u/InsertFunnyUser-name · 2026-09-11## [The Physics of Database Speed: from 300 to 1M transactions per second](https://www.reddit.com/r/programming/comments/1wch6vw/the_physics_of_database_speed_from_300_to_1m/)/u/tanayvk · 2026-09-10A 19 minute animated explainer video on database speed. I explain low-level database concepts, identify bottlenecks, run benchmarks and optimize write throughput to hit 1 million TPS.## [The lifecycle of a sharded Postgres query](https://www.reddit.com/r/programming/comments/1wcm90s/the_lifecycle_of_a_sharded_postgres_query/)/u/siren0x · 2026-09-10## [A modern, developer-first technical reference for Sitemaps](https://www.reddit.com/r/programming/comments/1wdspwr/a_modern_developerfirst_technical_reference_for/)/u/Stephcraft · 2026-09-11## [Overview of caching in PostgreSQL](https://www.reddit.com/r/programming/comments/1wcpbg6/overview_of_caching_in_postgresql/)/u/compy3 · 2026-09-10I haven't seen too many comprehensive approaches to this topic, so I took a swing at it.Goal isn't to be exhaustive, but to be comprehensive enough to provide a nice overview for people trying to get their bearings with the topic.Did I miss anything?## [Multitenancy with .NET and EF Core: A Deep Dive (.NET 10)](https://www.reddit.com/r/programming/comments/1wdbhz3/multitenancy_with_net_and_ef_core_a_deep_dive_net/)/u/RemigiuszZalewski · 2026-09-11Ever had a multi-tenant SaaS app where the only thing stopping Customer A from seeing Customer B's invoices is a \`Where TenantId ==\` clause someone remembered to write? In this deep dive I build real tenant isolation into EF Core 10 - two real tenants with real registration, login and invite flows (no dev-token shortcuts), a named global query filter that scopes every query automatically, and a SaveChangesAsync override that stamps TenantId on every insert so it's never left unset. I also show the one gotcha that makes EF Core 10 worth the upgrade for this: named query filters, so tenant isolation and soft-delete can finally coexist on the same entity instead of one silently overwriting the other. If you've ever shipped multi-tenancy on hope and code review, this is the version that makes the mistake structurally impossible.## [Optimizing a Spin-Lock](https://www.reddit.com/r/programming/comments/1wbr6an/optimizing_a_spinlock/)/u/david-alvarez-rosa · 2026-09-09## [What comes after git](https://www.reddit.com/r/programming/comments/1wdd9yd/what_comes_after_git/)/u/self · 2026-09-11## [Decoding the NEC V20 Microcode](https://www.reddit.com/r/programming/comments/1wc3hjq/decoding_the_nec_v20_microcode/)/u/self · 2026-09-10## [A Design Space Exploration of Async/Await](https://www.reddit.com/r/programming/comments/1wbw0pa/a_design_space_exploration_of_asyncawait/)/u/alexeyr · 2026-09-09## [High-performance Database Architecture - Interview with Tyler Cloutier](https://www.reddit.com/r/programming/comments/1wbwkvz/highperformance_database_architecture_interview/)/u/max123246 · 2026-09-09## [Mission-Critical (Joran Dirk Greef, TigerBeetle)](https://www.reddit.com/r/programming/comments/1wcescu/missioncritical_joran_dirk_greef_tigerbeetle/)/u/cdb_11 · 2026-09-10## [I spend a stupid amount of time on an issue I only half-care about. Now I will foist it on all of you! Enjoy :P](https://www.reddit.com/r/programming/comments/1wbhjda/i_spend_a_stupid_amount_of_time_on_an_issue_i/)/u/GetAGripGal · 2026-09-09## [Building more efficient locks (James Mitchell, 2024)](https://www.reddit.com/r/programming/comments/1wcdr28/building_more_efficient_locks_james_mitchell_2024/)/u/cdb_11 · 2026-09-10
Post listing with excerpts — 7.8 KB · feedType: "listing"
reddit.com/user/spezWhat Reddit serves

964 KB of HTML — karma cards, trophy case, follow prompts
What the API returns
markdown## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1wosm9/)/u/spez · 2026-08-05That was the thinking. Otherwise it would be easier to just replicate the UI.## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1w9sot/)/u/spez · 2026-08-05If we replace every line of code but the output is the same, is it still old Reddit?## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1w9j2v/)/u/spez · 2026-08-05Karma and Age gates are really blunt tools that, while we understand why they are used today, end up with a blast radius making the it hard for (good) new users finding a way to participate. That makes a bad experience. Our plan is to build tools so you no longer feel the need to rely on hammers like those. But we’ll make sure you can see it working better before proceeding.## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1vy2h1/)/u/spez · 2026-08-05I am once again coming to you to ask you to spend more time in this app.## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1vttld/)/u/spez · 2026-08-05Yep. We'll work closely with mod teams to test the new tools along side your old tools. We want our new tools to have fewer false positives, while still catching all the crud that should be kept out of your spaces, and you should be able to see this before we go forward. Our teams will also be working alongside your to help make the transitions once we're ready.## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1vrya9/)/u/spez · 2026-08-05I'm sorry what## [/u/spez on Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/p1vrf3r/)/u/spez · 2026-08-05> My only hope is that karma and account age filters don’t disappear before Reddit has actually proven that its own abuse detection tools work in the real world.That's the plan. We're testing it now with a few volunteer mods / subs. Still have some work to do.## [Modernizing Reddit’s infrastructure with you](https://www.reddit.com/r/u_spez/comments/1vgbkge/modernizing_reddits_infrastructure_with_you/)/u/spez · 2026-08-05Hi everyone,Last May, I shared how we were building Reddit for its [next chapter](https://www.reddit.com/user/spez/comments/1kfciml/reddits_next_chapter_smarter_easier_still_human/). I owe you an update, including a few changes I know some people will have strong opinions about.While we’ve made upgrades to the platform over the last [21 years](https://www.reddit.com/user/spez/comments/1u7hraf/21_years_of_reddit/), we need to continually evolve to meet the rising expectations of everyone—mods, users, developers. Namely, starting and moderating a community should be easier than it is today. New users should be able to easily discover and participate in communities they’re interested in. And we need to make it harder for bad actors to scrape and sell Reddit data.# Where we’re headingTo thrive for another 21 years (and hopefully more), we need to rethink some of our legacy systems. None of this is changing today. We’re sharing with you early because we need your input to get it right.Here’s what’s on the table:**Old Reddit:** I know I said [last year](https://www.reddit.com/user/spez/comments/1kfciml/reddits_next_chapter_smarter_easier_still_human/) that we wouldn’t be sunsetting Old Reddit (I even made a [meme](https://www.reddit.com/media?url=https%3A%2F%2Fcf.preview.redd.it%2Freddits-next-chapter-smarter-easier-still-human-v0-prh1c0ewzyye1.png%3Fwidth%3D1080%26format%3Dpng%26auto%3Dwebp%26s%3Da7c0c1232475b695897ad9f226f6c4b50f1bef15) about it, which [r/agedlikemilk](https://www.reddit.com/r/agedlikemilk/)), but the reality is we’re getting to that time where we need to make some changes. There are four groups of people who use Old Reddit: OG users ❤️, OG mods ❤️, Admins ❤️, and everyone who spams, scrapes, or does anything bad on Reddit 🖕. In order to protect our platform, business, and users, we will need to do something. Actually, a lot of somethings. We have options: We can limit access, migrate important uses, or rebuild it on a modern tech stack, and I think we’ll probably do all of the above.I love Old Reddit. It’s the platform I largely built—as a kid, 21 years ago—that somehow turned into the amazing platform and company we have today. We will preserve as much of it as we can. My dream would be to recreate the UI, if not the guts, including the HTML+CSS itself, on a modern foundation so it can live on (note: Between when I wrote this and when I posted it, [u/keysersosa](/u/keysersosa) made a demo of exactly this approach. Fingers crossed.).One thing we can do in the short term to mitigate the bad behavior we see Old Reddit used for is to limit access to logged-in users and mods, and migrate critical bots and mod workflows. This will give us some time to plan the more complex follow-up steps.**Automod:** This has been one of the most important mod tools. But it’s also hard to learn, hard to maintain, and heavily dependent on brittle keyword matching, regex, and inherited configurations that only a few people on a mod team, if any, understand. We can do better.We’re building new systems, including giving mods LLMs and AI-assisted tools to help them tackle their low-hanging (but time-consuming) fruit, so they can spend more time cultivating their community and less time policing. [u/Go\_JasonWaterfalls](/u/Go_JasonWaterfalls) will share more in [r/modnews](/r/modnews) today.**Public API:** Reddit’s public API wasn’t designed for today’s scale, automated abuse, or commercial scraping. We want useful bots, community tools, and good-faith developers to have a clear, well-supported way to build on Reddit. We don’t want bad actors to scrape Reddit indiscriminately, resell its data, or use it without accountability.To ensure a safe and secure Reddit, we're working with developers to build exclusively on Reddit's Developer Platform. [u/KeyserSosa](/u/KeyserSosa) will share more in [r/redditdev](/r/redditdev) today.**How people find and contribute to communities:** New users should be able to easily find relevant communities, understand their rules and norms, and make useful contributions. Today, new users encounter invisible barriers like account age and karma thresholds, unclear removals, and poor community discovery.Those safeguards exist for good reasons, including spam, brigading, and ban evasion. Our goal here is to improve Reddit’s systems and moderation tools so communities can rely less on blunt limits like karma and account age, and more on stronger abuse prevention built into the systems they use. This will make it easier for genuine new users to participate and easier for mods to welcome them with confidence.# How we’ll do thisWe know announcements about APIs and legacy products come with some [baggage](https://www.reddit.com/r/place/comments/159lksc/claim_your_i_was_here_ticket/). “Trust us” isn’t good enough. If we’re asking you to move to something new, it has to be at parity or better in practice, not just in theory. Here are the principles we'll use across this work:* None of this is changing now or has a set end date* We won’t remove major capabilities before there is a credible replacement* We’ll work directly with the mods, developers, and communities that depend on these systems* We’ll share milestones along the way before any of these changes land* We’ll judge success by outcomes: better tools, less abuse, less mod work, and healthier communities# What we need from you* **Developers:** If you build or maintain an app, [register it](https://developers.reddit.com/app-registration) and tell us what support would be needed to unblock migration. More on [r/redditdev](/r/redditdev) here. [LINK](https://www.reddit.com/r/redditdev/comments/1vgbm9c/our_plans_for_the_future_of_reddits_public_data/)* **Mods:** If your community depends on a bot someone else maintains, [tell us that too](https://forms.gle/htmmJ1Rbv7fotxLP6). And if you want to test new tooling, [sign up for the Mod Early Access program](https://survey.alchemer.com/s3/8688309/Reddit-Feedback-Roster). More on [r/modnews](/r/modnews) here. [LINK](https://www.reddit.com/r/modnews/comments/1vgbt2j/whats_next_for_mod_tools/)* **Everyone:** If you want to give us feedback as we work on any of the changes we’ve mentioned, sign up [here](https://survey.alchemer.com/s3/8688309/Reddit-Feedback-Roster).Our motivation behind all these changes is to make Reddit better for our users, mods, and communities who make Reddit what it is, and to limit the impact from those who take advantage of our platform or abuse our users and communities.We’re sharing this early so that the people who use these systems can help shape what comes next and ensure these changes make Reddit better for everyone.\- [u/spez](/u/spez)edit: added links## [/u/spez on Reddit Announces Q2’26 Earnings (plus AMA!)](https://www.reddit.com/r/RDDT/comments/1vb4oe8/reddit_announces_q226_earnings_plus_ama/p0rih9t/)/u/spez · 2026-07-30Reddit is for people talking to people, and protecting that trust is a top priority. I gave a more thorough update on this in [March](https://www.reddit.com/user/spez/comments/1s3ezrc/humans_welcome_bots_must_wear_name_tags/), but the TL;DR is we’re fighting bad bots and spam on several fronts: making Reddit harder to scrape at scale, using proactive models that prevent up to 23 million spam views per day, and revoking nearly 2 million inauthentic votes per day.Useful bots will be clearly labeled. Suspicious accounts may be asked to confirm there’s a human behind them, without requiring people to reveal their real-world identity. Communities will continue setting their own rules for AI-generated content—_but_ a recent [report by Pangram](https://www.pangram.com/blog/ai-in-your-feed) found that Reddit had one of the lowest scores for prevalence of AI-generated content of any platform.The hoodies are real; handwritten letters are fan fiction—but a good idea. Wish we had thought of it, but we were moving fast.## [/u/spez on Reddit Announces Q2’26 Earnings (plus AMA!)](https://www.reddit.com/r/RDDT/comments/1vb4oe8/reddit_announces_q226_earnings_plus_ama/p0ri6c3/)/u/spez · 2026-07-30Thank you for your support of RDDT.About a year ago we began rolling limits on moderation, including the limitation for redditors to moderate up to five communities with over 100k weekly visitors. We also changed our primary metric of a community’s activity from subscribers to weekly visitors, which is more indicative of traffic. We’ll continue to keep an eye on this.## [/u/spez on Reddit Announces Q2’26 Earnings (plus AMA!)](https://www.reddit.com/r/RDDT/comments/1vb4oe8/reddit_announces_q226_earnings_plus_ama/p0ri0bd/)/u/spez · 2026-07-30Our long-term goal hasn’t changed: 1 billion daily users globally and 100 million in the US. To get there, Reddit needs to become a daily destination, not a site people mainly discover through third-party search.We made good progress this quarter in a few areas that really matter here. New-user retention in the app improved 50% year over year on a relative basis, more communities are reaching a thriving state, and we’re getting better at turning people who first visit on the web into higher-quality app users who come back more often.We’re focused on what we can control, which is the core app experience. This is what will get us to that goal.## [/u/spez on Reddit Announces Q2’26 Earnings (plus AMA!)](https://www.reddit.com/r/RDDT/comments/1vb4oe8/reddit_announces_q226_earnings_plus_ama/p0rhxmo/)/u/spez · 2026-07-30We saw some impact after the initial launch of age verification in the UK about a year ago, but as we’ve gotten better at identifying users who should be ID’d, this has settled.The vast majority of Reddit users are adults, but we're committed to providing a safe experience for everyone who uses the platform, regardless of how regulations evolve globally. And we’re continuing to explore ways to strengthen safeguards for teens on the platform.## [/u/spez on Reddit Announces Q2’26 Earnings (plus AMA!)](https://www.reddit.com/r/RDDT/comments/1vb4oe8/reddit_announces_q226_earnings_plus_ama/p0rhup4/)/u/spez · 2026-07-30This is something we’ve discussed internally, but it’s not a priority at the moment. Our main focus continues to be making Reddit the best version of itself (faster, easier, better to use), versus layering in new features and experiences.I’m glad the carabiner found its audience.## [/u/spez on Reddit Announces Q2’26 Earnings (plus AMA!)](https://www.reddit.com/r/RDDT/comments/1vb4oe8/reddit_announces_q226_earnings_plus_ama/p0rhpwr/)/u/spez · 2026-07-30I took this one on the analyst call, but just in case folks missed my response...I had a couple of conversations with brands we’ve wanted on Reddit for a long time. What stood out was how much better advertisers understand Reddit now. They see that people come here with intent, looking for honest opinions and real recommendations, and that creates value that’s hard to find elsewhere.I also loved seeing how our team shows up at this event. They are our best evangelists: they know the product, understand our communities, and explain Reddit in a way that feels true to what it is. I always leave Cannes feeling really proud of how far we’ve come.PS - Carabiner idea was from yours truly. Not sure if I regret it or not.## [/u/spez on 21 years of Reddit](https://www.reddit.com/r/u_spez/comments/1u7hraf/21_years_of_reddit/os0o1vi/)/u/spez · 2026-06-16And thank you (mod tools suck) [u/shiruken](/u/shiruken)!## [/u/spez on 21 years of Reddit](https://www.reddit.com/r/u_spez/comments/1u7hraf/21_years_of_reddit/os0jtt9/)/u/spez · 2026-06-16You were the ride## [21 years of Reddit](https://www.reddit.com/r/u_spez/comments/1u7hraf/21_years_of_reddit/)/u/spez · 2026-06-16Hi everyone,Reddit turns 21 next week. Funny enough, it’s the same age I was when we started it. Save your jokes about [r/13or30](/r/13or30), I’ve already [heard them](https://i.redd.it/mup6rvwj0o7h1.png).That’s a long time in human years and an even longer time in internet years.When a few of us started Reddit back in 2005, the idea was simple: make it easier to find interesting things online. So we built a place where people could share links.And the links became prompts for conversations because people naturally like to talk about stuff. One of the first inside jokes on Reddit was, _"I didn't read the article but… \[insert 2000 words on the topic\]"_ because people are more interested in the conversation than the content itself.(It’s not only [inside jokes](https://www.reddit.com/r/tifu/comments/2tdbig/tifu_by_enraging_the_parents_of_my_girlfriend_by/), though. Sometimes it’s [heartfelt condolences](https://www.reddit.com/r/AskReddit/comments/5c79n0/comment/d9uf56l/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button).)And what started as a place to share links evolved, for the better, into a place to form communities. What we didn’t realize at the time was that 21 years later, those communities would become one of the last places online where you can still reliably hear from real people on almost any topic imaginable.The internet has become more powerful, automated, and optimized for attention. And on social media, everything feels performative: one big stage, one big feed, and someone (or some thing!) fighting for your attention.But most people don’t want to perform.They want to ask personal questions and get advice from someone who’s been there. They want to compare experiences, learn from others, and find people who care about the same things they do.Reddit works because it’s not one giant conversation. It’s a constellation of communities, each with its own culture, norms, and rules.Over the last couple of decades, I’ve learned that when people gather around shared interests, they act less like performers and more like neighbors (even if sometimes the [r/neighborsfromhell](https://www.reddit.com/r/neighborsfromhell) kind). When communities set their own rules, they protect what makes those spaces valuable. And when people can speak anonymously, they’re often more honest.For a long time, people assumed the future of the internet would be more tied to real-world identity. But one of the things Reddit has shown is that pseudonymity can create safety, honesty, and participation. On Reddit, you can openly talk about the things you care about—or are struggling with—without having your identity be part of the story.As AI becomes more pervasive, that kind of human conversation only becomes more important. Real opinions, lived experience, and personal judgment matter more when the rest of the internet is filling up with synthetic content.I shared in [March](https://www.reddit.com/user/spez/comments/1s3ezrc/humans_welcome_bots_must_wear_name_tags/) how we’re protecting Reddit’s authenticity without sacrificing your anonymity, and we’ll keep building in that direction.Since then, we’ve continued to defend Reddit against automated/bot/spammy content, including making it [harder to scrape Reddit at scale](https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting_communities_from_scrapers_and_platform/), creating proactive moderation models that prevent up to 23 million spam views per day, and guarding against vote manipulation by revoking nearly 2 million inauthentic votes per day.Because the value of Reddit has never been the interface (unless you’re the [Old Reddit](https://old.reddit.com/) type, I know there are still dozens of you out there). It’s never been the algorithm. And it’s never been polished, sanitized content.The value of Reddit is you.Everything interesting about Reddit has been created by its people: the communities, the comments, the inside jokes, the rare insults, the niche expertise, the support, the debates, the brutal honesty, and the countless times someone took a minute to help a stranger for no reason other than they could.That is the human internet that’s worth protecting.Thank you for spending these last 21 years with us. I’m excited to see what the next 21 will hold.\- [u/spez](/u/spez)## [/u/spez on u/spez Ted Talk](https://www.reddit.com/r/redditstock/comments/1u6nnyv/uspez_ted_talk/orucdtm/)/u/spez · 2026-06-15Haven’t forgotten about you 👊## [/u/spez on Steve, Jen, and Drew here — Ask Us Anything!](https://www.reddit.com/r/RDDT/comments/1tvs5jj/steve_jen_and_drew_here_ask_us_anything/optfyql/)/u/spez · 2026-06-05[https://preview.redd.it/f1xjmxgj3d5h1.jpeg?width=1260&format=pjpg&auto=webp&s=37fed0dc065a6553fa7a291f643bf95b60907962](https://preview.redd.it/f1xjmxgj3d5h1.jpeg?width=1260&format=pjpg&auto=webp&s=37fed0dc065a6553fa7a291f643bf95b60907962)Juuuust kidding. We’ll follow up with the hoodie plan.## [/u/spez on Steve, Jen, and Drew here — Ask Us Anything!](https://www.reddit.com/r/RDDT/comments/1tvs5jj/steve_jen_and_drew_here_ask_us_anything/optcg0g/)/u/spez · 2026-06-05[https://preview.redd.it/6j6mqriszc5h1.jpeg?width=1260&format=pjpg&auto=webp&s=d6ef9851633a7012a76d420b0ed7255d82dc950d](https://preview.redd.it/6j6mqriszc5h1.jpeg?width=1260&format=pjpg&auto=webp&s=d6ef9851633a7012a76d420b0ed7255d82dc950d)Oof. So close.## [/u/spez on Steve, Jen, and Drew here — Ask Us Anything!](https://www.reddit.com/r/RDDT/comments/1tvs5jj/steve_jen_and_drew_here_ask_us_anything/oprhecj/)/u/spez · 2026-06-04That is obviously where this is all heading.## [/u/spez on spez reads every comment in here](https://www.reddit.com/r/redditstock/comments/1twdbcz/spez_reads_every_comment_in_here/opq3e1a/)/u/spez · 2026-06-04He does## [/u/spez on Steve, Jen, and Drew here — Ask Us Anything!](https://www.reddit.com/r/RDDT/comments/1tvs5jj/steve_jen_and_drew_here_ask_us_anything/opmclva/)/u/spez · 2026-06-04I can’t comment on specific deals or timing.I will say that we are very aware that Reddit is an essential part of the AI and search ecosystem.## [/u/spez on Steve, Jen, and Drew here — Ask Us Anything!](https://www.reddit.com/r/RDDT/comments/1tvs5jj/steve_jen_and_drew_here_ask_us_anything/opmb8xp/)/u/spez · 2026-06-04If you talk to any of the early engineers from any of the major LLMS, they’ll all tell you Reddit’s data was essential in their creation.Reddit is the #1 most cited domain for AI across all models, per data collected by Profound. Our content is uniquely valuable to the AI ecosystem because it’s fresh, honest, and largely text-based. And this position still holds because the fresh part really matters: ongoing indexing is more valuable than static datasets. As I said in [Q1’26 earnings](https://s203.q4cdn.com/380862485/files/doc_financials/2026/q1/Q1-26-Shareholder-Letter.pdf), I believe our conversations are like oil for this modern internet.We’ve learned a lot over the last two years and those learnings should be reflected in future partnerships, including ways to make them more product-focused versus “data for dollars.” I can’t get into specifics about deals or renewals, but can say that we fully understand the value we bring to the table.## [/u/spez on Steve, Jen, and Drew here — Ask Us Anything!](https://www.reddit.com/r/RDDT/comments/1tvs5jj/steve_jen_and_drew_here_ask_us_anything/opmb76u/)/u/spez · 2026-06-04Since the Dev Platform beta opened in 2024, more than 2,000 developers have built apps used across 31,000+ communities, and we’ve seen good traction with mod tools, interactive experiences, and games. That’s important because it expands the canvas for what Reddit can be.There’s still a lot more to do there, but adoption is growing—installs of developer platform apps more than doubled from 2024 to 2025. The core technology is powerful, but there are a couple key features that will make it easier for subreddits to enjoy them (e.g. a games landing page, or the ability to have custom posts without “installing” the app).And for the World Cup specifically: we’ve got limited-edition 2026 national team kit avatars dropping tomorrow, so keep an eye out.
Activity feed, newest first — 23 KB · feedType: "listing"
What is covered, by URL pattern
Reddit support is measured per URL pattern, not claimed per domain. Every row below is verified against the live crawler.
| URL pattern | Status | What you get |
|---|---|---|
/r/<sub>/comments/<id>/ | Supported | Post body plus the comment thread, each comment with author and date. Comment permalinks resolve to the parent post. |
/r/<sub>/ | Supported | Current listing as structured entries — title, author, date, and excerpt per post. |
/r/<sub>/top · /new · /hot · ?t=… | Supported | Sorted and time-windowed views carry over through the query string. |
/user/<name>/ | Supported | The account’s public activity feed — its posts and comments in order. |
old.reddit.com/* | Supported | Legacy-host URLs are normalized to the same canonical feed — identical content either way. |
Reddit discussions without registering an app
Point the Crawl endpoint at a Reddit URL and the request is routed to Reddit’s public Atom feeds — the same feeds the site itself publishes. Post URLs return the body with the comment thread; subreddit and user URLs return the listing. No OAuth app, no session, no account on either side.
Comments come with the post
A post URL returns the thread, not just the body — every comment carries its author and date, and tables survive as Markdown.
Public feeds, not browser scraping
Each URL maps to the public Atom feed Reddit still serves. That is why no OAuth app or account is involved on the read path.
Verified per URL pattern
Every row in the matrix is reproduced from a live crawl of a real URL — support is measured per pattern, not claimed per domain.
Structured metadata for routing
results.metadata carries platform, feedType, subreddit, and commentCount or postCount — pipelines branch on fields, not on parsing the text.
What is a Reddit scraper API?
A Reddit scraper API is an HTTP interface that takes a Reddit URL and returns the discussion in a structured, model-ready format. Reddit retired its anonymous JSON endpoints in 2025 and rate-limits datacenter IPs aggressively, which is why most scrapers now need accounts or residential proxies. Search1API’s Crawl endpoint takes a different route: it reads the public Atom feeds Reddit still publishes, so a post arrives with its comment thread and a subreddit arrives as a listing — no Reddit account, no OAuth app, and no vote or write surface anywhere on the path.
Typical workflow
Send a public Reddit URL to the Crawl endpoint and get back structured Markdown — posts with comment threads, subreddit listings, and user activity feeds. No Reddit account or OAuth app needed.
POST a Reddit URL to the Crawl endpoint — no account, OAuth app, or session needed.
The URL is normalized to the matching public feed — post, subreddit, or user.
Structured content returns as Markdown plus results.metadata.platform, feedType, subreddit, and commentCount or postCount for downstream routing.
Pages that expose no public feed return a named failure rather than an empty page.
Where teams use it
Run social listening across subreddits — brand mentions and pain-point threads arrive with the full comment thread.
Build RAG and training corpora from real discussions — Q&A subreddits carry answer-quality signal in the comments.
Track competitor and market sentiment in niche communities, including sorted and time-windowed views.
Monitor a subreddit or a public account for new posts without polling the official API.
FAQ
Do I need a Reddit account or OAuth app?
No. The crawler reads the public Atom feeds Reddit publishes for posts, subreddits, and user pages. There is no app registration, no OAuth flow, and no account anywhere in the path.
Which Reddit URLs are supported?
Post and comment-permalink URLs, subreddit listings including sorted views like /top?t=week, and user activity pages. old.reddit.com URLs are normalized to the same feed.
Do I get the comments too?
Yes — a post URL returns the body plus the comment thread, each comment with its author and date. The count rides along in results.metadata.commentCount.
What format does the content come back in?
Clean Markdown plus structured metadata. Every Reddit response carries results.metadata.platform = "reddit" and results.metadata.feedType of post or listing, plus subreddit and a comment or post count.
How is this different from the official Reddit API?
The official API is an application platform — registered app, OAuth, per-account rate limits, and write scopes. This is read-only content extraction over public feeds: no credentials, and nothing to rate-limit against your own account.
Is scraping Reddit legal?
We only fetch content Reddit serves to anonymous visitors through its public feeds — no login, no session sharing, no circumvention of access controls. Whether a specific use complies with applicable law and Reddit’s terms depends on your jurisdiction and use case, so confirm that with your own counsel.