Skip to content

Hardcoded seeds update June 2015#6333

Merged
laanwj merged 3 commits intobitcoin:masterfrom
laanwj:2015_06_seed_update
Jun 25, 2015
Merged

Hardcoded seeds update June 2015#6333
laanwj merged 3 commits intobitcoin:masterfrom
laanwj:2015_06_seed_update

Conversation

@laanwj
Copy link
Member

@laanwj laanwj commented Jun 24, 2015

  • Moved all seed related scripts to contrib/seeds for consistency
  • Updated makeseeds.py to handle IPv6 and onions, fix regular expression for recent Bitcoin Core versions
  • Fixed a bug in generate-seeds.py with regard to IPv6 parsing
  • Ran scripts, produced new chainparamsseeds.h

Source data: https://dev.visucore.com/bitcoin/seeds-20150624.txt.xz retrieved 2015-06-24 09:28:55 +0200 from http://bitcoin.sipa.be/seeds.txt

Needs backport to 0.11.

@laanwj laanwj added the P2P label Jun 24, 2015
@jonasschnelli
Copy link
Contributor

ACK.

@PRabahy
Copy link
Contributor

PRabahy commented Jun 24, 2015

I think we need to check the data that http://bitcoin.sipa.be/seeds.txt is keeping at some point. I have been consistently running a node at 68.34.102.231:8335 that doesn't show up in that list at all. I have verified that this node is open and accessible using https://getaddr.bitnodes.io/.

Also, my node at 68.34.102.231:8333 only shows 34% uptime for 30 days and I believe that I have had closer to ~60-70% uptime. Overall I don't believe that this hurts the overall intent of this PR, but something just seems a bit off.

Edit: Node in second paragraph was supposed to say port 8333

@jonasschnelli
Copy link
Contributor

@PRabahy: i have checked and compared @Sipas dnsseed output agains my seed at bitcoin.seed.jonasschnelli.ch and the data seems to be up to date.

Your node at 68.34.102.231 is also not listed in my database. I tried to connect to your not whiteout success.

@laanwj
Copy link
Member Author

laanwj commented Jun 24, 2015

Well in any case, this needs a refresh. Someone (sorry, I don't remember who) said they went through the list a while ago and all but a few nodes were stale. This isn't surprising as last update was more than a year ago.

Note that only nodes on port 8333 are included in the built-in seeds. This is part of the regexp in makeseeds.py. Probably this was done with a reason, on the other hand there may be valid reasons to revise this e.g. ISPs blocking port 8333 as well as the DNS seeds. @sipa?

@sipa
Copy link
Member

sipa commented Jun 24, 2015

Hmm, I think the crawler prefers :8333 as that's the only port that's transferrable through DNS.

@sipa
Copy link
Member

sipa commented Jun 24, 2015

There is also a combine.pl script in https://github.com/sipa/bitcoin-seeder/ that can be used to first merge different crawlers's outputs together.

@laanwj
Copy link
Member Author

laanwj commented Jun 25, 2015

There are a few others with port 8335 in the original seeds.txt, just not @PRabahy's. @PRabahy is your node advertising itself properly, e.g. you don't have the wrong -externalip in your config file? (if any, without it it should autodiscover the right one)

I'll add port parsing logic to makeseeds.py.

laanwj added 3 commits June 25, 2015 08:05
- Moved all seed related scripts to contrib/seeds for consistency
- Updated `makeseeds.py` to handle IPv6 and onions, fix regular
  expression for recent Bitcoin Core versions
- Fixed a bug in `generate-seeds.py` with regard to IPv6 parsing
Allow for non-8333 nodes to appear in the internal seeds. This will
allow bitcoind to bypas a filter on 8333. This also makes it possible to
use the same tool for e.g. testnet.

As hosts with multiple nodes per IP are likely abusive, add a filter to
remove these (the ASN check will take care of them for IPv4, but not
IPv6 or onion).
@laanwj laanwj force-pushed the 2015_06_seed_update branch from 0636b78 to b932953 Compare June 25, 2015 06:06
@laanwj
Copy link
Member Author

laanwj commented Jun 25, 2015

OK, new commits pushed

Allow for non-8333 nodes to appear in the internal seeds. This will
allow bitcoind to bypas a filter on 8333. This also makes it possible to
use the same tool for e.g. testnet.
As hosts with multiple nodes per IP are likely abusive, add a filter to
remove these (the ASN check will take care of them for IPv4, but not
IPv6 or onion).

There are a few hardcoded seeds with ≠8333 ports now.

@PRabahy
Copy link
Contributor

PRabahy commented Jun 25, 2015

@laanwj That could be the problem. Right now I haven't set -externalip for either node and they are both behind a NAT router. FYI, :8333 is running bitcoin-qt and :8335 is running btcd. Later today I try to figure out if they are advertising the correct IP.

@ghost
Copy link

ghost commented Jun 25, 2015

Tested ACK.

@paveljanik
Copy link
Contributor

Do we need a port number even when it is standard? It could save a bit...

@laanwj
Copy link
Member Author

laanwj commented Jun 25, 2015

Do we need a port number even when it is standard? It could save a bit...

But at least now it can be stored in a simple, network-agnostic table with fixed-sized records. We went from a separate table for IPv4 and IPv6+onion to a unified one, let's not split it up again (for - at most - 10% saving).

@laanwj laanwj merged commit b932953 into bitcoin:master Jun 25, 2015
laanwj added a commit that referenced this pull request Jun 25, 2015
b932953 Hardcoded seeds update June 2015 (Wladimir J. van der Laan)
884454a contrib: Add port parsing to makeseeds.py (Wladimir J. van der Laan)
ccd4369 contrib: Improvements to hardcoded seeds scripts (Wladimir J. van der Laan)
@laanwj
Copy link
Member Author

laanwj commented Jun 25, 2015

Cherry-picked (and squashed) to 0.11 as 41bbc85

laanwj added a commit that referenced this pull request Jun 25, 2015
- Moved all seed related scripts to contrib/seeds for consistency
- Updated `makeseeds.py` to handle IPv6 and onions, fix regular
  expression for recent Bitcoin Core versions
- Fixed a bug in `generate-seeds.py` with regard to IPv6 parsing

Allow for non-8333 nodes to appear in the internal seeds. This will
allow bitcoind to bypas a filter on 8333. This also makes it possible to
use the same tool for e.g. testnet.

As hosts with multiple nodes per IP are likely abusive, add a filter to
remove these (the ASN check will take care of them for IPv4, but not
IPv6 or onion).

Github-Pull: #6333
Rebased-From: ccd4369 884454a b932953
@PRabahy
Copy link
Contributor

PRabahy commented Jun 25, 2015

I think I figured out what is going on with my nodes. I have both IP4 and IP6 setup on my machine and I have a publicly accessible IP6 address. When bitcoin starts up it appears to only autodetect IP6 addresses. The problem with this is that I never setup IP6 port forwarding on my router (IP4 is forwarded properly). I'm going to open the IP6 port and see if that changes the statistics at all.

@bitcoin bitcoin locked as resolved and limited conversation to collaborators Sep 8, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants