Commit Graph

64 Commits

Author SHA1 Message Date
aikaterna
e4daca09a9 [RSS] Fix for media_plaintext tag (#263) 2022-03-04 16:32:18 -08:00
aikaterna
1792e683f3 [RSS] Various fixes
* Handle feeds that don't have a link in the feed entry  
* Do not check title matching if a feed entry has a non-matching link and a greater entry time than last post time  
* Fix for $tags_list template key as it was setting it to the last tag found instead of the entire list, also check for duplicate tags during tag finding and do not add them
2022-02-12 18:06:17 -08:00
aikaterna
474619a858 [RSS] Don't clean config on dead channels 2022-01-23 11:38:45 -08:00
aikaterna
d0bf0ec89e [RSS] Test out enclosure media plaintext tags 2022-01-07 16:42:37 -08:00
aikaterna
a361fec9b7 [RSS] Add catch for ServerDisconnectedError 2022-01-07 11:20:55 -08:00
aikaterna
15a93e6796 [RSS] Add rss listall for all feeds in a server 2022-01-05 14:47:05 -08:00
aikaterna
149c050fcc [RSS] Play nicer with titleless feed entries pt 2 2021-10-27 10:16:09 -07:00
PredaaA
43902aefc9 Add missing data statements. (#251) 2021-10-18 16:56:05 -07:00
aikaterna
d34732def7 [RSS] Support specific "image" tag format
If "image" is a dict and has an "href" tag inside, map it to $image_plaintext
2021-10-16 14:07:31 -07:00
aikaterna
9147d128af [RSS] Black format @ 120 2021-10-16 14:05:09 -07:00
aikaterna
ba60619244 [RSS] Play nicer with titleless feed entries 2021-10-14 19:48:11 -07:00
aikaterna
e224a0310d [RSS] Escape ipv4-like regex a bit better 2021-10-14 19:47:38 -07:00
aikaterna
ed1179bf10 [RSS] Patch out any ip addresses in bozo response 2021-10-13 09:41:50 -07:00
aikaterna
84ed247331 Info.json cleanup 2021-10-10 14:22:45 -07:00
aikaterna
40b3bbc363 Info.json cleanup 2021-10-10 13:26:33 -07:00
James
7b0b4496bc [RSS] Replace scipy KDTree with Euclidean distance (#245)
* Replace scipy KDTree with Euclidean distance

* fixed star expression and missing import

* Version number

Co-authored-by: aikaterna <20862007+aikaterna@users.noreply.github.com>
2021-08-13 14:50:54 -07:00
jack1142
e10b4c90a9 Update RSS's loop to not stop on an unexpected error (#229) 2021-04-30 15:51:49 -07:00
aikaterna
1173e49e6a [RSS] Make sure pubparsed is used when selected 2021-03-18 16:56:09 -07:00
aikaterna
cc8a55f062 [RSS] Fetch channel fix part 2 2021-03-15 09:50:44 -07:00
aikaterna
92a2bd5b73 [RSS] Fetch channel fix 2021-03-15 09:36:55 -07:00
aikaterna
608bcaebcd [RSS] Explain embed image/thumbnail tags 2021-03-11 11:25:26 -08:00
aikaterna
3b72243f91 [RSS] Add time parsing override for specific feeds
This is an owner only addition to provide a way to use published_parsed for post qualification instead of updated_parsed. YouTube RSS feeds are defaulted into this list.
2021-03-08 19:12:35 -08:00
aikaterna
2b3ab743ee [RSS] User facing improvments
* More descriptive error messages for users
* Now will post updates of last post sent
* Handles feeds that do not have entries
* Better channel verification for removing dead feeds
2021-03-03 09:20:40 -08:00
aikaterna
fafafa9859 [RSS] Catch timeout errors 2021-02-10 12:03:43 -08:00
aikaterna
4044b0c83d [RSS] Specific tag format adjustment 2021-01-29 12:57:41 -08:00
aikaterna
fbe505d3c6 [RSS] Fix for tags + catch channel feed names 2021-01-26 08:53:35 -08:00
aikaterna
d408adddd8 [RSS] Small fixes for rss find 2021-01-24 11:32:00 -08:00
jack1142
d8c29b09b4 :( (#197) 2021-01-08 09:41:58 -08:00
jack1142
76aaed32bc [RSS] URL is required param so let's have it that way in the signature (#196)
* [RSS] URL is required param so let's have it that way in the signature

* version

Co-authored-by: aikaterna <20862007+aikaterna@users.noreply.github.com>
2021-01-08 09:24:40 -08:00
aikaterna
acb8756ec1 [RSS] Add connection timeout catch for rss find 2020-12-25 09:59:23 -08:00
aikaterna
1ee9958594 [RSS] Add rss find 2020-12-24 17:21:55 -08:00
aikaterna
fd32a9b370 [RSS] Account for None on post time 2020-12-04 15:17:58 -08:00
aikaterna
0134a704fd [RSS] New posts must be newer than last saved time 2020-12-03 16:00:30 -08:00
aikaterna
9cee901493 [RSS] Add feed character limit 2020-11-04 12:54:37 -08:00
aikaterna
51911b4e28 [RSS] Text formatting change on settings 2020-10-23 08:14:39 -07:00
aikaterna
405164137d [RSS] Provisional tag qualification 2020-10-21 16:41:27 -07:00
jack1142
edb5be3a25 Avoid dispatching when there's no feed updates (#173)
* Avoid dispatching when there's no feed updates

* version bump
2020-10-14 07:06:53 -07:00
jack1142
763539f352 [RSS] Add feed update dispatch (#168)
* Add feed update dispatch

* version

Co-authored-by: aikaterna <20862007+aikaterna@users.noreply.github.com>
2020-10-13 09:00:30 -07:00
aikaterna
ddd8c14d03 [RSS] Try for an image instead of assume 2020-10-13 08:57:48 -07:00
aikaterna
65bd1386cc [RSS] Account for aiohttp fetch failure 2020-10-06 16:29:58 -07:00
aikaterna
b431b599ae [RSS] Catch feeds that have no content 2020-10-05 08:43:06 -07:00
jack1142
5bfbc3b83b [RSS] Make RSS work with cog disabling API (#160)
* [RSS] Make RSS work with cog disabling API

* Update feed qualifier to work with disabling

Instead of the catch-all dealing with feeds having no time, just let the catch-all handle everything. If the cog has been disabled for a long period of time and there are no matches via the saved feed information, the feed will only post 1 feed post instead of all of them (10, 20, 25 posts depending on the feed usually). If the cog is reinstated and there is only a partial match (say, 18 out of 20 feeds before it finds a qualifying match)... it will still post all 18 posts.

Co-authored-by: aikaterna <20862007+aikaterna@users.noreply.github.com>
2020-10-05 08:42:07 -07:00
aikaterna
d6c052dcfd [RSS] Different list unpacking 2020-10-01 15:10:34 -07:00
aikaterna
eb0ff5bdeb [RSS] Update info.json 2020-10-01 12:06:20 -07:00
aikaterna
6fdb24a7c4 [RSS] Provisional list unpacking 2020-10-01 11:41:57 -07:00
aikaterna
8c81e8a42b [RSS] Cleaner twitch content 2020-09-30 08:34:35 -07:00
aikaterna
185af4a19e [RSS] Time tags & special case pinterest feeds 2020-09-29 21:58:17 -07:00
aikaterna
891a124834 [RSS] Add datetime to time tag validation 2020-09-29 20:39:44 -07:00
aikaterna
dc6419deed [RSS] More feed fun, pt 6 2020-09-29 20:03:46 -07:00
aikaterna
98781b9268 [RSS] More feed fun, pt 5 2020-09-29 17:59:32 -07:00