Arun Shah™@lemmy.world to Technology@lemmy.ml · 1 month agoTop 10 website in the world ( July 2025 )lemmy.mlimagemessage-square31fedilinkarrow-up198
arrow-up198imageTop 10 website in the world ( July 2025 )lemmy.mlArun Shah™@lemmy.world to Technology@lemmy.ml · 1 month agomessage-square31fedilink
minus-squarePechente@feddit.orglinkfedilinkarrow-up1·1 month agoMy comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
minus-squareclb92@feddit.dklinkfedilinkarrow-up3·30 days agoDumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
My comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
Dumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
Good pod cast