Sitebulb
p/sitebulb
The website auditing tool for SEO consultants and agencies
Ria Blagburn
Sitebulb — Crawl and visualize your website structure
Featured
40

Sitebulb is a website crawler for Windows and Mac that actually audits your site for you, presenting comprehensive lists of prioritised, context-specific hints that bubble up important issues. Sitebulb's intuitive visualizations help you understand deep-rooted issues and better communicate complex ideas with your clients or colleagues.

Replies
Corey Eulas
I've had the opportunity to use this tool during the beta period. In short: wow. Great addition to any true marketers toolbox. Awesome recommendation feature and the visualization is valuable addition.
Patrick Hathaway
@coreyeulas Thanks Corey, and thanks for your help testing.
Anthony D. Nelson

I used Sitebulb for one month during the Beta period. Very nice product at launch that I'm certain will be updated regularly and become even more valuable over time.

Pros:

Beautiful UI. Impressive visualizations and charts make for easy reporting. Great tool for quickly assessing the SEO health of a large site.

Cons:

Currently no custom extraction feature (or I missed it)

Patrick Hathaway
Thanks Anthony! Gareth has been busy TODAY building a new version of our content extractor. Seems a popular request :)
John-Henry Scherck

It's a beautiful product for advanced technical SEO that you can feel confident using. It provides solid recommendations and is very easy to use. I picked it up in a matter of minutes.

Pros:

Clean interface and really good reporting

Cons:

It's a bit slower than some other crawlers

Paul Shapiro
My favorite part of Sitebulb, especially compared to other, similar products has been the organization of the crawl information. It's just a little bit more in-line with what I'm looking for when auditing a website for any issues.
Patrick Hathaway
@fighto Thanks for the comment Paul. We tried as best we could to approach it from the perspective of: 'when doing an audit for SEO, how do users work through each section.' Although we had to rip it apart and put it back together again more than a few times!
CCarter

I never took SEO audits seriously until I started with the beta of Sitebulb. The interface is easy to use and the segmentation makes organizing and knowing what to focus on effortless!

I already bought a subscription - came here to support a great product!

Pros:

Easy Interface

Cons:

Nada

Patrick Hathaway
Thank you, and thanks for signing up!
Chris Dyson

I've been fortunate enough to be able to test out @Sitebulb as part of the beta release and I am also a long term user of @urlprofiler (also by Gareth and Patrick)

This is a great tool and I have had very few issues crawling sites in excess of 100k URLs

Pros:

Crawl Map Visualisations, Easy to understand reports

Cons:

White label Reporting for Agencies

Patrick Hathaway
Thanks Chris! We've got something in the works already for the white label reporting, watch this space. P.S. You wrote 'userprofiler'...
Gareth Brown
Cheers Chris - Looks like reports are going to get prioritised!
Tom Davenport
I've been using the beta of this product and it's fantastic. Has replaced Deep Crawl, the former gold standard in technical SEO crawl tools, and gives a nice clear overview of issues to fix. I'm sure there's more to come and they've been responsive to feedback and bugs through the beta, so looking forward to seeing how Sitebulb continues to improve in future. Question for you @hathawayp; where do you see Sitebulb going in the future? Any features you were keen to include that didn't make it to this initial launch?
Patrick Hathaway
@tomdavenport Hey Tom, thanks for the kind words :) There are a few big features which we are really keen to build, which definitely seem to be in demand based on our feedback so far: - 'Printable' Reports: Generating PDF reports automatically for users, either to be shared internally or sent to clients. - Segments: Allowing users to segment their site based on page type (e.g. 'products', 'blog posts') and building reports/drilldowns based on these segments. - Scheduling: Allowing users not only to queue (as they can now) but also to schedule crawls to run at a specific time.
Wayne Barker

Ive been using this as a beta user for some time and for the price you arent going to find anything else that points you in the right direction like sitebulb does. It makes complex technical issue easier to understand and the exports are super organised.

Pros:

Simple to use. Easy to understand

Cons:

Segmentation ;)

Patrick Hathaway
Segments are on their way!
Peyton Hayslette
This looks really awesome. Solid mix of visualization and presentation of opportunities for improvement. Excited to give it a whirl!
Patrick Hathaway
@peytonhayslette Thanks Peyton, glad you like the look of it. Any questions just ping me.
Patrick Hathaway
Hi everyone, I'm the co-founder of Sitebulb. Myself and Gareth (the other co-founder) will be on-hand all day to answer any questions. We started Sitebulb with a vision of creating a website crawler that combines the power and reporting functionality of a cloud-based crawler, with the cost and convenience of a desktop one. Some of the specific pain points we’re addressing are: 1. Scale – Sitebulb saves to a database rather than storing crawl data in RAM, meaning a typical desktop computer can comfortably crawl 500,000+ page websites. 2. Reporting – the reports are designed to highlight potential issues and help SEOs get to the root of the problem without having to manipulate a ton of data. 3. Visualization – Sitebulb’s interactive Crawl Maps help solve one of the most pervasive issues with technical SEO: understanding and communicating website structure. It’s always been important to us that our products are affordable to pretty much anyone doing SEO, which is one of the reasons we’ve focused on desktop products. Our ultimate goal is to help small agencies and consultants do amazing technical SEO work. There's a free 2 week trial for everyone, with no credit card required - just head over to the site and download. If you've got feedback about the tool; we'd love to hear from you. Patrick P.S. Thanks @riaface for Hunting us!
Michael J. Kovis

Sitebulk is easily lives up to their homepage statements of being the most "powerful website crawler with the world's most insightful reporting system".

I've used plenty of other website crawlers, but Sitebulb has the most options to integrate with other tools like Moz, Google Analytics, Majestic, etc. Having access to all this data in one place is absolutely priceless.

If you're not a subscriber already, you should be. Especially if you do a lot of audits and use several different tools to compile data to give your clients actionable items.

Pros:

Amazing UI. Fantastic visuals and reporting.

Cons:

If you need a fast site crawl, this tool isn't for you.

Dave Collins

I've worked with Botify, screaming frog, the link-assistant tool, seomator, raven, moz and others. I think all of them? This is very much the audit tool that I've been looking for.

Pros:

Beautifully presented actionable data. Clear. Easy to use. Fast. No limits to usage. Low system resource guzzling.

Cons:

One or two very minor reporting issues. Fully expect these to be fixed soon.

Patrick Hathaway
Thanks Dave, great to hear. If we didn't have the occasional bug, Gareth would have nothing to do... (seriously don't worry, we're on them).
Joona Tuunanen

Started to use Sitebulb when they launched their public beta. Definitely a good alternative to other similar tools with a bit of extra (=crawlmaps). Interesting to see the evolution of this product.

Pros:

Crawlmaps <3, good visualisations, covers most things you need

Cons:

No custom extraction (yet), would be nice to be able to change the colors to match our agencys branding

Patrick Hathaway
Thanks Joona :) Custom extraction is on the roadmap (we already do it in URL Profiler) but we'd like to do a more comprehensive job of helping users identify the right selectors. Changing colours is a new one! Do you mean the overall interface, or the graphs etc...?
Stacey MacNaught
Looks great, guys. Quick question - realistically, on a site with say 100,000 URLs (so not absolutely huge) how long would you expect a complete crawl to take?
Patrick Hathaway
@staceycav Hey Stacey. Well, that question is a little bit like 'how long is a piece of string'. There are a number of variables that affect how long a crawl will take, the biggest one obviously being how many URLs there are. And a site with 100,000 URLs indexed in Google could easily have 300,000 URLs when you include resources, external links etc... But for the sake of argument let's call it 100,000 HTML URLs in total, with no page resources switched on. On most websites it's not healthy (not to mention polite) to crawl TOO fast, so we recommend a speed of 5 URLs/second. At that rate you can crawl a 100k site in about 6 hours (including time to build the reports at the end). However, sometimes even 5 URLs/second is too fast for some websites, and can cause the server to slowdown. Sitebulb is able to detect this and slow it's crawling rate down, so as not to cause any user disruption. For example, I crawled a 100k page site the other day and it took almost exactly 12 hours (~2.8 URLs/second). I've written more on all this here: https://sitebulb.com/resources/g... Thanks for the question!
Ade Lewis

I can't recommend Sitebulb highly enough to anyone involved in SEO. It's also great for development teams to ensure that any changes made don't have an impact on site crawlability.

Pros:

Really, really in-depth data especially around internal link architecture

Cons:

Not that I kind find :-)

Ghost Kitty
Comment Deleted
Dan Thornton

I've been using Sitebulb during the beta period, and found it really useful for any projects involving SEO, whether that's doing a quick overview and check, or a full website audit.

I've used most of the competitors, and it seems to be the best yet for being able to run a full website crawl and analysis in a way that's easy to understand and share. Which means I can easily use it to demonstrate to clients without having to explain reams of spreadsheets (which is nice).

Crawled urls by depth is a really nice addition to help locate bottlenecks with navigation and internal linking

Pros:

Nice visualisations which are easy to understand or send straight to clients.

Covers everything from tiny to pretty big sites

Cons:

Adding sharable client reports and page type segments are on the way, and I can't wait.....

Gareth Brown
Thanks Dan. Client reports and page segments are just the beginning. Our new feature list will keep us busy until 2020!
Tom Demers

The tool is really useful and affordable, and having been a part of the beta the development team was super responsive and active in getting / responding to feedback and making updates, and are obviously users / smart SEOs themselves so I'm sure the tool will continue to evolve and offer more cool / valuable features over time.

Pros:

As others have mentioned the crawl visualizations are unique and super helpful for diagnosing issues with site structure

Cons:

I don't have any issues with the tool but there is overlap with tools like Deep Crawl and Screaming Frog (I have started to use all three)

Patrick Hathaway
Thanks Tom (and thanks for all beta feedback). I have at various stages of my career rolled with 2 or 3 crawlers that I use regularly, so I personally feel there is room for overlapping products - especially if they have different strengths.
🚀 Pierre-Henry 💡
Great job! Will give a try very soon!
Joe Sinkwitz
My agency has been a beta user for the last 6 months and we're pleased with where the product is at. It's better than certain loud amphibians and tech crawlers named after evil space aliens.
Patrick Hathaway
LOL thanks @cygnusseo - and thanks for your assistance with our launch and throughout the beta. So many helpful people in our community :)