Wiby is now free software

Hello IQfy, I've been building wiby for quite a while and finally have it to a point featurewise where I think it would be useful for other people to build their own search engines. It is meant to run on cheap hardware and be easy to control once its installed. The installation might take you some time though.

The install guide is located at http://wiby.me/about/guide.html

Thank you

CRIME Shirt $21.68

UFOs Are A Psyop Shirt $21.68

CRIME Shirt $21.68

  1. 2 years ago
    Anonymous

    the name sounds like willy and willy means dick lmao

  2. 2 years ago
    Anonymous

    Today OP was not a homosexual.

    Very nice.

  3. 2 years ago
    Anonymous

    That is really cool. I will look into it more once I get home

  4. 2 years ago
    Anonymous

    Well done! Frick web 2.0 and 3.0

  5. 2 years ago
    Anonymous

    Thanks anon this is great news.
    Will you every make the current index of Wiby public?

    • 2 years ago
      Anonymous

      >Will you every make the current index of Wiby public?
      Probably not. I want to encourage people to build independent indexes, although there's nothing stopping people from putting a shared index together.

      >Is it possible to create bundles of different domains to submit all at once
      There is the /bulksubmit/ feature that admins can access to submit lists of websites all at once. Not sure what the Amazon completion thing is though.

      >I assume it will eat quite a bit of data if you crawl through stack-overflow-like sites and forums.
      It sure would. Probably not possible to do something of that scale without lots of money for hardware.

      • 2 years ago
        Anonymous

        >I want to encourage people to build independent indexes
        Why do you want that?

        • 2 years ago
          Anonymous

          >Why do you want that?
          The web is too centralized these days.

          • 2 years ago
            Anonymous

            Triplet of truth.

        • 2 years ago
          Anonymous

          Damn! Who's he?

          • 2 years ago
            Anonymous

            Frank William Abagnale, Jr.

          • 2 years ago
            Anonymous

            my future wife

  6. 2 years ago
    Anonymous

    Nice job OP. Will try to run it when I'll get an unlimited network plan, I assume it will eat quite a bit of data if you crawl through stack-overflow-like sites and forums.

    From what I've so far it seems you create submissions of websites to crawl and the admin adds them into the list of places to checks.

    Is it possible to create bundles of different domains to submit all at once, like an easily shareable package / text file with a list and does it supports * completion, something like amazon.* to get all the derivative websites ? Or can you for now only add top level domains one by one.

    • 2 years ago
      Anonymous

      replied here

      >Will you every make the current index of Wiby public?
      Probably not. I want to encourage people to build independent indexes, although there's nothing stopping people from putting a shared index together.

      >Is it possible to create bundles of different domains to submit all at once
      There is the /bulksubmit/ feature that admins can access to submit lists of websites all at once. Not sure what the amazon completion thing is though.

      >I assume it will eat quite a bit of data if you crawl through stack-overflow-like sites and forums.
      It sure would. Probably not possible to do something of that scale without lots of money for hardware.

  7. 2 years ago
    Anonymous

    thanks for open sourcing it, OP.
    will look into it

  8. 2 years ago
    Anonymous

    Are you really the wiby dev? Amazing work!
    The first time I tried it was in 2020 and it still had that Google proxy feature lol

    • 2 years ago
      Anonymous

      Yes, thanks! Its a shame I had to end the google proxy but it was too much of a time sink

  9. 2 years ago
    Anonymous

    Cool project OP

  10. 2 years ago
    Anonymous

    >http://wiby.me/
    I see you index Neocities, nice. Google censors it.
    Coverage of the Installgentoo Wiki is a bit more sketchy.

  11. 2 years ago
    Anonymous

    Free as in free beer?

    • 2 years ago
      Anonymous

      im not really sure is that good or bad? Its GPLv2.

  12. 2 years ago
    Anonymous

    Awesome! Wiby is a really cool project and I've shown it to some real life people who aren't IQfy spergs and people like it, at least as a novelty.

  13. 2 years ago
    Anonymous

    ...
    Uhh
    How do we know you are actually the developer of wiby?

    • 2 years ago
      Anonymous

      you dont, and thats the beauty of /gee/

    • 2 years ago
      Anonymous

      unless someone's been lying in autistic wait for the github user wibyweb to post source code after having no activity for over a year and then rushing to make a IQfy post, it's more than likely the real dev, but then again

      you dont, and thats the beauty of /gee/

      • 2 years ago
        Anonymous

        >someone's been lying in autistic wait
        Sounds like IQfy.

    • 2 years ago
      Anonymous

      >How do we know you are actually the developer of wiby?
      You'll never know for sure and I would always keep it that way.

      didn't know you were a fellow IQfyentooman. thank you for your service.

      Thank you. I have not tried gentoo but do have an Arch laptop and a m.2 Arch recovery drive on my pc.

      Would love to contribute to the project, because I've tried several times, and to be honest the search results are really unsatisfactory. But Im glad there is a search engine that is truly anti-corpo

      The index is slowly growing as more people submit pages.

      There's another one I've also seen before called Marginalia (looks like it went open source 2 months ago too). Not quite the same concept as Wiby though since Wiby aims to crawl simple websites whereas Marginalia just removes the centralized corporation ones afaik.

      [...]
      +1 internet

      It is a good alternative and its good alternatives exist

      You're a saint. Thank you!

      No thank you! I'm glad that people enjoy it

      based. I use wiby occasionally and always enjoy the results. thanks for your work if its really you.

      cheers

  14. 2 years ago
    Anonymous

    is this the mongoloid effect or was this called "wibr" once upon a time? i remember you first dropping this on here

  15. 2 years ago
    Anonymous

    didn't know you were a fellow IQfyentooman. thank you for your service.

  16. 2 years ago
    Anonymous

    lookin good op
    #cloudhired

  17. 2 years ago
    Anonymous

    Would love to contribute to the project, because I've tried several times, and to be honest the search results are really unsatisfactory. But Im glad there is a search engine that is truly anti-corpo

    • 2 years ago
      Anonymous

      There's another one I've also seen before called Marginalia (looks like it went open source 2 months ago too). Not quite the same concept as Wiby though since Wiby aims to crawl simple websites whereas Marginalia just removes the centralized corporation ones afaik.

      https://i.imgur.com/Bj0DOWO.jpg

      Hello IQfy, I've been building wiby for quite a while and finally have it to a point featurewise where I think it would be useful for other people to build their own search engines. It is meant to run on cheap hardware and be easy to control once its installed. The installation might take you some time though.

      The install guide is located at http://wiby.me/about/guide.html

      Thank you

      +1 internet

  18. 2 years ago
    Anonymous

    Ayy thanks so much OP.
    Wiby is really nice, although I don't use it that often.
    You have also reminded me that I gotta submit a few websites.
    Anyway, cheers! To you!

  19. 2 years ago
    Anonymous

    You're a saint. Thank you!

  20. 2 years ago
    Anonymous

    Wait... a thread that's actually... about something? Where's the coffee?

  21. 2 years ago
    Anonymous

    based. I use wiby occasionally and always enjoy the results. thanks for your work if its really you.

  22. 2 years ago
    Anonymous

    what are the requirements for the PHP version?

    • 2 years ago
      Anonymous

      install php and php-gd, which is already listed as a req in the guide anyway

      Ayy thanks so much OP.
      Wiby is really nice, although I don't use it that often.
      You have also reminded me that I gotta submit a few websites.
      Anyway, cheers! To you!

      cheers friend

      • 2 years ago
        Anonymous

        >php and php-gd
        which one, 7.2/7.3/5.6 or what

        • 2 years ago
          Anonymous

          7.0 and up

  23. 2 years ago
    Anonymous

    I probably don't have a use case for this myself, but you made the right choice, OP. Thank you.

  24. 2 years ago
    Anonymous

    I saw your post on HN, keep it up, homosexual!

  25. 2 years ago
    Anonymous

    does it have federation of sorts?

  26. 2 years ago
    Anonymous

    OP delivered, thank you. I will look into it and use it.

  27. 2 years ago
    Anonymous

    This vs searx?

    • 2 years ago
      Anonymous

      Brave Search >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Shitx > Wiby

      • 2 years ago
        Anonymous

        Kys

      • 2 years ago
        Anonymous

        Why are there so many pajeet morons like on IQfy?

      • 2 years ago
        Anonymous

        >he trusts his search history to a marketing company.

    • 2 years ago
      Anonymous

      you can use it as part of searx

  28. 2 years ago
    Anonymous

    What a stupid gimmick of a site.

    • 2 years ago
      Anonymous

      You got what you searched for, what is your problem?

    • 2 years ago
      Anonymous

      You are a literal idiot.

  29. 2 years ago
    Anonymous

    the best way to use wiby, in my opinion, is to just use the "surprise me..." feature. It brings back that adventurous feeling of the old internet.

  30. 2 years ago
    Anonymous

    Wiby is awesome so I will definitely read through this later, one thing I am curious about though is are there any protections in place for SQL injection by default in the application server? Considering how long Wiby the website has been up I'm assuming that is protected against SQLi, but just wondering if that protection is part of the source code or something on your hosted instance specifically. Or maybe SQLi isn't a problem for generic web apps using LAMP/LEMP anymore, I haven't done any web hosting in a long time

    • 2 years ago
      Anonymous

      Injection protection is built in.

      • 2 years ago
        Anonymous

        Cool thanks

  31. 2 years ago
    Anonymous

    good shit op

  32. 2 years ago
    Anonymous

    Thanks man wiby is great.Keep up the good work

  33. 2 years ago
    Anonymous

    Wiby in Spanish is the most common slang for boy dick, usually a nickname to talk about a kid's willy without sounding like a creep.

    %8 of the global population which speaks Spanish is now going to be thinking about little boy dick every time they use Wiby or are told to "wiby" something.

    #NamingFail

    • 2 years ago
      Anonymous

      >Wiby in Spanish is the most common slang for boy dick
      I did not know that and I also don't care. Wiby also appears to be a name in some asian regions.

    • 2 years ago
      Anonymous

      Third-worlders filtered out by default? This just keeps getting better

    • 2 years ago
      Anonymous

      I speak spanish and that's not true. Which shithole country are you from?

    • 2 years ago
      Anonymous

      spanish speaker here, never in my life have I ever heard of this word, must be some chilean "spanish" slang or you're just a moron

      • 2 years ago
        Anonymous

        Thank you for confirming the troll post

  34. 2 years ago
    Anonymous

    Why did you write certain components in c

    • 2 years ago
      Anonymous

      I enjoy it for its speed and the challenge because its deceptively hard at managing memory. Someone once said its like riding a motorcycle.

  35. 2 years ago
    Anonymous

    Bump.
    The only good thread on this board.
    Amazing work, OP.

    • 2 years ago
      Anonymous

      thank you anon

      I wanted to come into this thread and dump on you OP but this is very cool. Good work.

      appreciated

      Would you mind explaining the practical information gathering benefits of using something like this beyond, say:
      >Avoiding censorship
      >Privacy control
      >No ads
      >Debloated results
      It's not like managing control over those things is unimportant, but I'd think it would take a lot of time/resources to index content from human intervention, at least to a useful degree when it comes to specific information gathering. For example, say I play Japanese-language games and want a guide, store, or other resource, and all those resources are split between sites for various games. Wouldn't I need to manually arrange for individual sites to crawl to create my "Japanese RPG index" source? In that case, I might need to use another engine anyway if I don't know of them currently.

      I want to clarify that I do think the project looks cool. I like the idea of a debloated, FOSS search engine without an obscene amount of unrelated results vying for my attention. Maybe if this gets enough traction, you can get some Linux distros to use this in their default browsers too.

      >I'd think it would take a lot of time/resources to index content from human intervention
      In my case, people willingly stepped up anonymously to submit content. It is still a slow process, but its not resource intensive with anonymous help. Make no mistake it takes effort to build an index and there is no free lunch to it. You can try scouring the entire web with a more widespread crawling approach, but expect to spend a lot more money with that approach.

      >Wouldn't I need to manually arrange for individual sites to crawl to create my "Japanese RPG index" source?
      Yes you would, but hopefully you aren't the only one doing the work, hopefully there are other people helping you to make submissions.

      In Google's case, it wasn't actually just two developers building the search engine, they had a host of other people helping them develop it as well as millions of dollars. Today, I heard that Alphabet employes something like 20k people involved in "reviewing" things they are indexing. In other words, they have an army of people involved in curation of their index. It is not fully automated.

      Ultimately it is a huge win for ordinary people to be able to host their own search engines instead of being relegated just to link directories.

      • 2 years ago
        Anonymous

        Thanks for taking the time to explain this further to me. Helps for me to build a stronger understanding and perspective. In a way, it feels as if this online landscape that is more streamlined and broadly-indexed is, in a way, significantly more confined and isolated. As such, it is neat to see projects like this that challenge this ethos. Keep it up, OP.

        • 2 years ago
          Anonymous

          No problem
          > In a way, it feels as if this online landscape that is more streamlined and broadly-indexed is, in a way, significantly more confined and isolated
          I think its something to do with traffic being too centralized around only a few centers. Despite there being far more people online than before, the universe feels smaller.

      • 2 years ago
        Anonymous

        >an army of people involved in curation of their index
        This could explain why they make Installgentoo WIki and Neocities practically invisible on their search engines. And it is evil.

  36. 2 years ago
    Anonymous

    I wanted to come into this thread and dump on you OP but this is very cool. Good work.

  37. 2 years ago
    Anonymous

    Would you mind explaining the practical information gathering benefits of using something like this beyond, say:
    >Avoiding censorship
    >Privacy control
    >No ads
    >Debloated results
    It's not like managing control over those things is unimportant, but I'd think it would take a lot of time/resources to index content from human intervention, at least to a useful degree when it comes to specific information gathering. For example, say I play Japanese-language games and want a guide, store, or other resource, and all those resources are split between sites for various games. Wouldn't I need to manually arrange for individual sites to crawl to create my "Japanese RPG index" source? In that case, I might need to use another engine anyway if I don't know of them currently.

    I want to clarify that I do think the project looks cool. I like the idea of a debloated, FOSS search engine without an obscene amount of unrelated results vying for my attention. Maybe if this gets enough traction, you can get some Linux distros to use this in their default browsers too.

  38. 2 years ago
    Anonymous

    based site, thank you OP. what user agent does your crawler use? i want to whitelist it and submit my shit

    • 2 years ago
      Anonymous

      you can whitelist this IP: 172.93.49.59

      Based as frick, you're awesome OP
      I've used wiby a couple of times before, glad to see it's still going strong

      thanks anon

  39. 2 years ago
    Anonymous

    Based as frick, you're awesome OP
    I've used wiby a couple of times before, glad to see it's still going strong

  40. 2 years ago
    Anonymous

    I cannot believe someone in here produced something useful.
    What's the catch?

    • 2 years ago
      Anonymous

      The catch is that when you use it, you don't get the pleasure of knowing that you are benefiting a progressive company that appreciates diversity and the environment like Google.

Your email address will not be published. Required fields are marked *