- Update to 2.29:
Added:
* New enabled option for all jobs. Set to false to disable a job without needing to remove it or comment it out (Requested in #625, contributed in #785)
* Command line options to enable and disbale jobs (Requested in #813, contributed in #820)
* New option ignore_incomplete_reads (Requested in #725, contributed in #787)
* New option wait_for in browser jobs (Requested in #763, contributed in #810)
* Added tags to jobs and the ability to select them at the command line (#789)
* New filter re.findall (Requested in #804, contributed in #805)
* Added tags to jobs and the ability to select them at the command line (#789, #824)
* New reporter: gotify (#823)
Changed:
* Remove EOL'd Python 3.7 (new minimum requirement is Python 3.8), add Python 3.12 testing
* Adds optional reply_to option for email reporters (#794)
* Replace the dead dependency appdirs with platformdirs (#811, #819)
* New concurrency test (#806)
* jobs.yaml sanity checks now allows the file to be owned by root (#828)
Fixed:
* email reporter: Allow multiple recipients for sendmail method (#797)
* Fix documentation for watching Github tags and releases, again (#723)
* Fix --test-reporter command-line option so separate configuration option is no longer ignored when sending test notifications (#772)
* Fix line height and dark mode regression (#774, PRs #777 and #778)
* Fix compatibility with lxml >= 5 which caused the CSS Selector filter to fail (#783 reported, PR #786)
* Fix pep8 test to ignore files in the site-packages directory for cases where the venv is in the project directory (#788)
* Fix HTML diff table rendering for long line lengths (#793)
* Fix IndexError after failed edit (#801)
* Fix concurrency issue in Python 3.12 by upgrading to minidb 2.0.8 (fixes#779)
OBS-URL: https://build.opensuse.org/request/show/1218754
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/urlwatch?expand=0&rev=27
Added:
* New enabled option for all jobs. Set to false to disable a job without needing to remove it or comment it out (Requested in #625, contributed in #785)
* Command line options to enable and disbale jobs (Requested in #813, contributed in #820)
* New option ignore_incomplete_reads (Requested in #725, contributed in #787)
* New option wait_for in browser jobs (Requested in #763, contributed in #810)
* Added tags to jobs and the ability to select them at the command line (#789)
* New filter re.findall (Requested in #804, contributed in #805)
* Added tags to jobs and the ability to select them at the command line (#789, #824)
* New reporter: gotify (#823)
Changed:
* Remove EOL'd Python 3.7 (new minimum requirement is Python 3.8), add Python 3.12 testing
* Adds optional reply_to option for email reporters (#794)
* Replace the dead dependency appdirs with platformdirs (#811, #819)
* New concurrency test (#806)
* jobs.yaml sanity checks now allows the file to be owned by root (#828)
Fixed:
* email reporter: Allow multiple recipients for sendmail method (#797)
* Fix documentation for watching Github tags and releases, again (#723)
* Fix --test-reporter command-line option so separate configuration option is no longer ignored when sending test notifications (#772)
* Fix line height and dark mode regression (#774, PRs #777 and #778)
* Fix compatibility with lxml >= 5 which caused the CSS Selector filter to fail (#783 reported, PR #786)
* Fix pep8 test to ignore files in the site-packages directory for cases where the venv is in the project directory (#788)
* Fix HTML diff table rendering for long line lengths (#793)
* Fix IndexError after failed edit (#801)
* Fix concurrency issue in Python 3.12 by upgrading to minidb 2.0.8 (fixes#779)
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=53
- Update to 2.28:
* Browser jobs: Migrate from Pyppeteer to Playwright (#761, #751)
- Update to 2.27:
Added:
* css and xpath filters now accept a sort subfilter to sort matched elements lexicographically
Fixed:
* Rework handling of running from a source checkout, fixes issues with example
files when urlwatch was run as /usr/sbin/urlwatch, e.g. on Void Linux (fixes#755)
* Add support for docutils >= 0.18, which deprecated frontend.OptionParser (fixes#754)
* Browser jobs: Fix support for Python 3.11 with @asyncio.coroutine removal (#759)
OBS-URL: https://build.opensuse.org/request/show/1084225
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/urlwatch?expand=0&rev=25
* Browser jobs: Migrate from Pyppeteer to Playwright (#761, #751)
- Update to 2.27:
Added:
* css and xpath filters now accept a sort subfilter to sort matched elements lexicographically
Fixed:
* Rework handling of running from a source checkout, fixes issues with example
files when urlwatch was run as /usr/sbin/urlwatch, e.g. on Void Linux (fixes#755)
* Add support for docutils >= 0.18, which deprecated frontend.OptionParser (fixes#754)
* Browser jobs: Fix support for Python 3.11 with @asyncio.coroutine removal (#759)
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=48
- Update to 2.26:
Added:
* browser job: Add support for specifying useragent (#700)
* Document how to ignore whitespace changes (PR#707)
* shell reporter: Call a script or program when chanegs are detected (fixes#650)
* New separate configuration option for reporters to split reports into one-per-job
* --change-location option allowing job location to be changed without losing job history (#739)
Changed:
* Docs: Re-group diff-related topics and improve wording (PR#712)
* Improved HTML e-mail diff style, including Dark Mode support (#730)
* Require Python >= 3.7, as Python 3.6 was EOL'd on 2021-12-23
* Dockerfile: Shrink image by switching to an Alpine-based Python 3.11
base image, this reduces the container size from 1 GiB to 151 MiB (#731)
* --gc-cache can now take a parameter to keep more than 1 historical snapshot (#732)
Fixed:
* Limit e-mail header length to 78 characters to avoid issues with some SMTP servers (PR#703, fixes#702)
* Fix a ResourceWarning for unclosed files when running unit tests (PR#698)
* Add support for html2text 2.1.1 and newer by feature-checking -utf8 support via -help (fixes#718)
* html2text options were only applied to the first job when using job_defaults (PR#726, fixes#588)
* Update Github tags watch filter documentation with new XPath (fixes#723)
* Fix --gc-cache to clear unknown keys when using Redis storage (fixes#743)
OBS-URL: https://build.opensuse.org/request/show/1078448
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/urlwatch?expand=0&rev=24
Added:
* browser job: Add support for specifying useragent (#700)
* Document how to ignore whitespace changes (PR#707)
* shell reporter: Call a script or program when chanegs are detected (fixes#650)
* New separate configuration option for reporters to split reports into one-per-job
* --change-location option allowing job location to be changed without losing job history (#739)
Changed:
* Docs: Re-group diff-related topics and improve wording (PR#712)
* Improved HTML e-mail diff style, including Dark Mode support (#730)
* Require Python >= 3.7, as Python 3.6 was EOL'd on 2021-12-23
* Dockerfile: Shrink image by switching to an Alpine-based Python 3.11
base image, this reduces the container size from 1 GiB to 151 MiB (#731)
* --gc-cache can now take a parameter to keep more than 1 historical snapshot (#732)
Fixed:
* Limit e-mail header length to 78 characters to avoid issues with some SMTP servers (PR#703, fixes#702)
* Fix a ResourceWarning for unclosed files when running unit tests (PR#698)
* Add support for html2text 2.1.1 and newer by feature-checking -utf8 support via -help (fixes#718)
* html2text options were only applied to the first job when using job_defaults (PR#726, fixes#588)
* Update Github tags watch filter documentation with new XPath (fixes#723)
* Fix --gc-cache to clear unknown keys when using Redis storage (fixes#743)
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=46
- Update to 2.25:
Added:
* Add a colored setting for the Discord reporter, enabled by
default (PR#683)
* Add a splitlines filter for trimming leading/trailing whitespace
in each line (PR#693)
* If a shell job fails, the job's stdout and stderr are added to
the error message (fixes#689)
* shell job: Add optional stderr key to customize how output on
stderr is treated
* Add --dump-history JOB command-line option to print historic
job outputs (fixes#681)
* Add display / empty-diff configuration option to skip reports when
diffs are empty due to diff_filter (fixes#692)
* New man pages: urlwatch-intro(7), urlwatch-deprecated(7),
urlwatch-cookbook(7), urlwatch-jobs(5), urlwatch-filters(5),
urlwatch-config(5) and urlwatch-reporters(5).
Changed:
* Require minidb 2.0.6; issue VACUUM only with --gc-cache (fixes#690)
* For shell jobs, stderr output isn't sent to urlwatch's stdout anymore;
add stdout: urlwatch to your shell job definition if you depend on
the old default behavior
Fixed:
* pytest command-line arguments are not wrongly interpreted by
CommandConfig anymore (fixes#677)
OBS-URL: https://build.opensuse.org/request/show/962616
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/urlwatch?expand=0&rev=23
Added:
* Add a colored setting for the Discord reporter, enabled by
default (PR#683)
* Add a splitlines filter for trimming leading/trailing whitespace
in each line (PR#693)
* If a shell job fails, the job's stdout and stderr are added to
the error message (fixes#689)
* shell job: Add optional stderr key to customize how output on
stderr is treated
* Add --dump-history JOB command-line option to print historic
job outputs (fixes#681)
* Add display / empty-diff configuration option to skip reports when
diffs are empty due to diff_filter (fixes#692)
* New man pages: urlwatch-intro(7), urlwatch-deprecated(7),
urlwatch-cookbook(7), urlwatch-jobs(5), urlwatch-filters(5),
urlwatch-config(5) and urlwatch-reporters(5).
Changed:
* Require minidb 2.0.6; issue VACUUM only with --gc-cache (fixes#690)
* For shell jobs, stderr output isn't sent to urlwatch's stdout anymore;
add stdout: urlwatch to your shell job definition if you depend on
the old default behavior
Fixed:
* pytest command-line arguments are not wrongly interpreted by
CommandConfig anymore (fixes#677)
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=44
- Update to 2.24:
Added:
* The Telegram reporter has gained two new options:
silent: Receive message notification without sound
monospace: Format message in monospace style
* Support for running a subset of jobs by specifying their index
on the command line
Changed:
* Migrated CI pipeline from Travis CI to Github Actions
* user_visible_url can now be specified for all job types (#654)
* Added a remove-duplicate-lines filter.
* Added a csv2text filter.
* Set envelope from (-f option) when sending emails using sendmail
* It is now possible to override the HTTP method when data is set
on a URL job
Fixed:
* Fix UnboundLocalError when SMTP auth is enabled, but keyring
is not installed (#667)
OBS-URL: https://build.opensuse.org/request/show/940291
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/urlwatch?expand=0&rev=22
Added:
* The Telegram reporter has gained two new options:
silent: Receive message notification without sound
monospace: Format message in monospace style
* Support for running a subset of jobs by specifying their index
on the command line
Changed:
* Migrated CI pipeline from Travis CI to Github Actions
* user_visible_url can now be specified for all job types (#654)
* Added a remove-duplicate-lines filter.
* Added a csv2text filter.
* Set envelope from (-f option) when sending emails using sendmail
* It is now possible to override the HTTP method when data is set
on a URL job
Fixed:
* Fix UnboundLocalError when SMTP auth is enabled, but keyring
is not installed (#667)
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=43
Added:
* New filter: pretty-xml to indent/pretty-print XML documents
* New filter: jq to parse, transform, and extract JSON data
* New reporter: prowl
Fixed:
* Proper multi-line highlighting for wdiff (PR#615)
* Fix command-line generation for html2text (PR#619)
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=41
- Update to 2.22:
Added:
* Added 'wait_until' option to browser jobs to configure how long
the headless browser will wait for pages to load.
* Jobs now have an optional treat_new_as_changed (default false)
key that can be set, and will treat newly-found pages as changed,
and display a diff from the empty string (useful for diff_tool
or diff_filter with side effects)
* New reporters: discord, mattermost
* New key user_visible_url for URL jobs that can be used to show a
different URL in reports (useful if the watched URL is a REST API
endpoint, but the report should link to the corresponding web page)
* The Markdown reporter now supports limiting the report length via
the max_length parameter of the submit method. The length limiting
logic is smart in the sense that it will try trimming the details first,
followed by omitting them completely, followed by omitting the summary.
If a part of the report is omitted, a note about this is added to the
report. (PR#572, by Denis Kasak)
Changed:
* Diff output is now generated more uniformly, independent of whether
the input data has a trailing newline or not; if this behavior is not
intended, use an external diff_tool (PR#550, by Adam Goldsmith)
* The --test-diff-filter output now properly reports timestamps from the
history entry instead of the current date and time (Fixes#573)
* Unique GUIDs for jobs are now enforced at load time, append "#1",
"#2", ... to the URLs to make them unique if you have multiple different
jobs that share the same request URL (Fixes#586)
* When a config, urls file or hooks file does not exist and should be
edited or inited, its parent folders will be created (previously only
the urlwatch configuration folder was created; Fixes#594)
OBS-URL: https://build.opensuse.org/request/show/860139
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=39
- Update to 2.21:
Added:
* Added --test-reporter REPORTER command-line option to send an
example report using any configured notification service
* JobBase now has main_thread_enter() and main_thread_exit() functions
that can be overridden by subclasses to run code in the main thread
before and after processing of a job
Removed:
* The --test-slack command line option has been removed, you can test
your Slack reporter configuration using --test-reporter slack
Changed:
* The browser job now uses Pyppeteer instead of Requests-HTML for
rendering pages while executing JavaScript; this makes JavaScript
execution work properly
Fixed:
* Applying legacy hooks.py filters
- Update to 2.20:
Added:
* A job can now have a diff_filter set, which works the same way as
the normal filter (and has the same filters available), but applies
to the diff output instead of the page content (can be tested with
--test-diff-filter, needs 2 or more historic snapshots in the cache)
* Documentation now has a section on the configuration settings
(--edit-config)
* New filter: ocr to convert text in images to plaintext
(using Tesseract OCR)
* New reporters:
- ifttt to send an event to If This Then That (ifttt.com)
(#512, by Florian Gaultier)
OBS-URL: https://build.opensuse.org/request/show/823689
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=37
- Update to 2.18:
Added:
* New filter: re.sub that can replace/remove strings using regular
expressions
* Support ignore_timeout_errors and ignore_too_many_redirects for
URL jobs (#423, by Josh aka Zevlag)
* HTML reporter: Add viewport meta tag for improved viewing on
mobile devices (#432, by Mike Borsetti)
* Optional support for insecure SMTP password storage in the
config; use with caution (#431)
Fixed:
* Fix --test-filter when the specified job is not found
* Fix another YAMLLoadWarning in unit tests (#382, by Louis Sautier)
* Documentation updates and typo fixes (by Nate Eagleson)
* Pushover: Fix default device config (Fixes#409 and #372,
documented by Richard Goodwin)
Changed:
* Nicer formatting of --features for jobs with no docstring
or many keys
* The XPath and CSS filters now support XML namespaces
(#404, by Chenfeng Bao)
* Drop support for Python 3.3 and Python 3.4 (new minimum
requirement is Python 3.5)
* Use html.escape instead of cgi.escape (which was removed
in Python 3.8; #424, by Chenfeng Bao)
* Allow non-ASCII characters in format-json output filter
(#433, by Mike Borsetti)
OBS-URL: https://build.opensuse.org/request/show/799967
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=35
- Update to 2.17:
Added:
* XPath/CSS: Support for excluding elements (#333, by Chenfeng Bao)
* Add support for using external diff_tool on Windows (#373, by Chenfeng Bao)
* Document how to use Amazon Simple E-Mail Service "SES" (by mborsetti)
* Compare data with multiple old versions (compared_versions, #328, by Chenfeng Bao)
Fixed:
* YAML: Fix deprecation warnings (#367, by Florent Aide)
* Updated manpage with new options: Authentication, filter tests (Fixes#351)
* Text formatter: Do not emit empty lines for line_length=0 (Fixes#357)
Changed:
* SMTP configuration fix: Only use smtp.user config if it's a non-empty value
OBS-URL: https://build.opensuse.org/request/show/694174
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=31
- Update to 2.16:
* Added XPath: Handle /text() selector (#282)
* Added document how to specify cookies to README.md (#264)
* Added text Reporter: minimal config option to only print a summary (PR#304, fixes#147)
* Added README.md: Document how to watch Github releases via XPath (#266)
* Added jupport for parsing XML/RSS with XPath (Fixes#281)
* Allow explicit setting of encoding for URL jobs (PR#313, contributes to #306)
* Added Slack Channel Reporter (PR#309)
* Added ANSI color output on the Windows console via colorama (PR#296, closes#295)
* Added support for using CSS selectors via the cssselect module (PR#321, closes 273)
* ignore_http_error_codes is now an option for URL jobs (PR#325, fixes#203)
* Added job_defaults in the config for globally specifying settings (PR#345, closes#253)
* Added Optional timeout (in seconds) for URL jobs to specify socket timeout (PR#348, closes#340)
* Remvoed support for JSON storage (dead code that was never used in production; PR#336)
* HtmlReporter now also highlights links for browser jobs (PR#303)
* Allow --features and --edit-* to run without urls.yaml (PR#301)
* When a previous run had errors, do not use conditional GETs (PR#313, fixes#292)
* Explicitly specify JSON pretty print separators for consistency (PR#343)
* Use data-driven unit tests/fixtures for easier unit test maintenance (PR#344)
* Fix migration issues with case-insensitive filesystems (#223)
* Correctly reset retry counter when job is added or unchanged (PR#291, PR#314)
* Fix a FutureWarning on Python 3.7 with regard to regular expressions (PR#299)
* If the filter list is empty, do not process the filter list (PR#308)
* Fix parsing/sanity-checking of urls.yaml after editing (PR#317, fixes#316)
* Fix Python 3.3 compatibility by depending on enum34 there (PR#311)
* Fix migration issues introduced by PR#180 and #256 (PR#323, fixes#267)
OBS-URL: https://build.opensuse.org/request/show/668990
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=29
- Update to 2.14:
* Added filter to pretty-print JSON data: format-json (by Niko Böckerman, PR#250)
* Added list active Telegram chats using --telegram-chats (with fixes by Georg Pichler, PR#270)
* Added support for HTTP ETag header in URL jobs and If-None-Match (by Karol Babioch, PR#256)
* Added xupport for filtering HTML using XPath expressions, with lxml (PR#274, Fixes#226)
* Added install_dependencies to setup.py commands for easy installing of dependencies
* Added ignore_connection_errors per-job configuration option (by Karol Babioch, PR#261)
* Improved code (HTTP status codes, by Karol Babioch PR#258)
* Improved documentation for setting up Telegram chat bots
* Allow multiple chats for Telegram reporting (by Georg Pichler, PR#271)
OBS-URL: https://build.opensuse.org/request/show/632966
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=23
- Update to 2.6
* New filters: sha1sum, hexdump, element-by-class
* New reporters: pushbullet; mailgun
* Improved filters: BeautifulSoup support for html2txt
* Improved handlers: HTTP Proxy; support for file:// URIs
* CI Integration: Build configuration for Travis CI
* Consistency: Feature list is now sorted by name
* Issue #108: Fix creation of example files on first startup
* Issue #118: Fix match filters for missing keys
* Small fixes
OBS-URL: https://build.opensuse.org/request/show/449929
OBS-URL: https://build.opensuse.org/package/show/network:utilities/urlwatch?expand=0&rev=10
