 Astro
|
52c0200da9
|
gatherer: add css
|
2022-11-06 23:49:17 +01:00 |
|
Astro
|
7913f6fa5f
|
hunter/worker: fetch a maximum of 40 posts
|
2022-11-06 22:30:43 +01:00 |
|
Astro
|
5174e9e235
|
gatherer: render spelling and hosts
|
2022-11-06 02:20:36 +01:00 |
|
Astro
|
23e3c689a6
|
gatherer: delint
|
2022-11-06 02:20:22 +01:00 |
|
Astro
|
44a365b572
|
gather: add webserver
|
2022-11-06 01:29:58 +01:00 |
|
Astro
|
bd7604f639
|
cave: init
|
2022-11-05 20:51:18 +01:00 |
|
Astro
|
c3039f96b6
|
gatherer: add PoC
|
2022-11-05 20:04:31 +01:00 |
|
Astro
|
6ac923f270
|
hunter/redis_store: ignore future or ancient posts
|
2022-11-05 19:45:59 +01:00 |
|
Astro
|
02f047d469
|
hunter: add more logging
|
2022-11-05 03:29:07 +01:00 |
|
Astro
|
2fdd0e079b
|
hunter/worker: don't pass host to save_post()
|
2022-11-05 03:26:34 +01:00 |
|
Astro
|
44a3d68201
|
hunter/worker: simplify error case, hardcode interval_after_error
|
2022-11-05 03:25:30 +01:00 |
|
Astro
|
36adb5f324
|
don't discard foreign posts
|
2022-11-04 15:58:03 +01:00 |
|
Astro
|
8d097e2f33
|
don't ignore foreign posts
|
2022-11-04 15:50:25 +01:00 |
|
Astro
|
36b1d688db
|
s/Post.url/Post.uri/
|
2022-11-04 15:50:00 +01:00 |
|
Astro
|
9c51946284
|
worker: lower DEFAULT_INTERVAL from 3600s to 60s
|
2022-11-03 21:18:15 +01:00 |
|
Astro
|
c7a92a519d
|
store known hosts in redis only after successful fetch
|
2022-11-03 21:17:21 +01:00 |
|
Astro
|
4222ce97dc
|
improve debug logging
|
2022-11-03 20:59:36 +01:00 |
|
Astro
|
98fade50f4
|
limit connections
|
2022-11-03 20:48:36 +01:00 |
|
Astro
|
43a6bea225
|
nixos-module: add option services.caveman.hunter.logLevel
|
2022-11-03 19:57:30 +01:00 |
|
Astro
|
7f58b194b1
|
LICENSE: init agpl-3.0
|
2022-11-03 19:51:10 +01:00 |
|
Astro
|
9e9e651b10
|
add nixos-module
|
2022-11-03 19:49:00 +01:00 |
|
Astro
|
ca66146eb3
|
save hosts to/load from redis
|
2022-11-03 18:58:37 +01:00 |
|
Astro
|
d0a5f11040
|
feed: lower-case hosts
|
2022-11-03 17:37:06 +01:00 |
|
Astro
|
420d53aa61
|
notify systemd
|
2022-11-03 17:34:29 +01:00 |
|
Astro
|
748ccd4f59
|
use env_logger
|
2022-11-03 17:22:21 +01:00 |
|
Astro
|
293e26e0ec
|
add .gitignore
|
2022-11-03 17:18:19 +01:00 |
|
Astro
|
63ee84b93c
|
move into subdir hunter/
|
2022-11-03 17:17:39 +01:00 |
|
Astro
|
c0c83cb776
|
redis_store: store tag by language
|
2022-11-03 17:13:11 +01:00 |
|
Astro
|
7ad3accf82
|
redis_store: expire posts
|
2022-11-03 17:12:47 +01:00 |
|
Astro
|
9682ba2424
|
main: exit on panic
|
2022-11-03 16:50:15 +01:00 |
|
Astro
|
6ea08de8f0
|
write to redis from worker
|
2022-11-03 16:17:04 +01:00 |
|
Astro
|
ef95c834e4
|
s/World/Scheduler?
|
2022-11-03 15:40:20 +01:00 |
|
Astro
|
c0ed026d89
|
add debug output
|
2022-11-03 15:39:05 +01:00 |
|
Astro
|
f6d86376d1
|
introduce hosts from mentions
|
2022-11-03 03:42:13 +01:00 |
|
Astro
|
91c00e8027
|
trends: check if new, also store by instance
|
2022-11-03 02:54:56 +01:00 |
|
Astro
|
f9e3f1e452
|
fix timing
|
2022-11-03 02:54:36 +01:00 |
|
Astro
|
a5cd57b278
|
trends: also filter out bots
|
2022-11-03 02:49:38 +01:00 |
|
Astro
|
edfc6fe7b4
|
trends: init
|
2022-11-03 01:38:24 +01:00 |
|
Astro
|
ba4eb9cf37
|
worker: remove some unwraps
|
2022-11-03 00:27:16 +01:00 |
|
Astro
|
bd01de758f
|
fix next_interval heuristic
|
2022-11-02 23:20:53 +01:00 |
|
Astro
|
a7a87f3c55
|
penalize feeds without updates
|
2022-11-02 23:10:59 +01:00 |
|
Astro
|
6439eb611d
|
implement next_interval heuristics
|
2022-11-02 22:42:43 +01:00 |
|
Astro
|
deaa232716
|
feed: make application.website optional
|
2022-11-02 22:42:20 +01:00 |
|
Astro
|
7b7c803ef5
|
config, max_workers
|
2022-11-02 22:06:43 +01:00 |
|
Astro
|
9b4ae05fc5
|
fixes
|
2022-11-02 21:49:37 +01:00 |
|
Astro
|
b3aab86e8a
|
nixify
|
2022-11-02 21:49:16 +01:00 |
|
Astro
|
7ade8d1aae
|
spider feeds
|
2022-11-02 21:12:26 +01:00 |