Commit Graph

20 Commits

Author SHA1 Message Date
1cf7e200ab hunter: rework scheduling algorithm 2022-11-07 00:58:28 +01:00
7913f6fa5f hunter/worker: fetch a maximum of 40 posts 2022-11-06 22:30:43 +01:00
bd7604f639 cave: init 2022-11-05 20:51:18 +01:00
6ac923f270 hunter/redis_store: ignore future or ancient posts 2022-11-05 19:45:59 +01:00
02f047d469 hunter: add more logging 2022-11-05 03:29:07 +01:00
2fdd0e079b hunter/worker: don't pass host to save_post() 2022-11-05 03:26:34 +01:00
44a3d68201 hunter/worker: simplify error case, hardcode interval_after_error 2022-11-05 03:25:30 +01:00
36adb5f324 don't discard foreign posts 2022-11-04 15:58:03 +01:00
8d097e2f33 don't ignore foreign posts 2022-11-04 15:50:25 +01:00
36b1d688db s/Post.url/Post.uri/ 2022-11-04 15:50:00 +01:00
9c51946284 worker: lower DEFAULT_INTERVAL from 3600s to 60s 2022-11-03 21:18:15 +01:00
c7a92a519d store known hosts in redis only after successful fetch 2022-11-03 21:17:21 +01:00
4222ce97dc improve debug logging 2022-11-03 20:59:36 +01:00
98fade50f4 limit connections 2022-11-03 20:48:36 +01:00
9e9e651b10 add nixos-module 2022-11-03 19:49:00 +01:00
ca66146eb3 save hosts to/load from redis 2022-11-03 18:58:37 +01:00
d0a5f11040 feed: lower-case hosts 2022-11-03 17:37:06 +01:00
420d53aa61 notify systemd 2022-11-03 17:34:29 +01:00
748ccd4f59 use env_logger 2022-11-03 17:22:21 +01:00
63ee84b93c move into subdir hunter/ 2022-11-03 17:17:39 +01:00