Qubes/core-admin
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
6,003 Commits 1 Branch 0 Tags 20 MiB
46cc4ca910
Commit Graph

46 Commits

Author SHA1 Message Date
Marek Marczykowski-Górecki
46cc4ca910
tests: collect detailed diagnostics on failure 
Help debugging test failures by collecting detailed information on
failure. It will be logger to the standard logger, which will end up
either on stderr or in journalctl.
 2020-08-08 20:36:42 +02:00
Marek Marczykowski-Górecki
60b8b40317
tests: move IPv6 tests into separate file 
Move to qubes.tests.integ.network_ipv6.
Again, to allow scheduling as a separate openQA job.
 2020-06-06 04:07:55 +02:00
Marek Marczykowski-Górecki
586526c072
tests: move vm update test to a seprate file 
This allows scheduling them in a separate job on openQA
 2020-06-06 04:07:54 +02:00
Marek Marczykowski-Górecki
4e6472b018
tests: switch simple http server to python3 
Python2 is phased out and not available anymore in some templates.
 2020-05-27 13:41:02 +02:00
Marek Marczykowski-Górecki
8965e9a8e4
tests/network: let xl devd bring the interfaces up 
xl devd doesn't use startup notify, so when the service is started
(according to systemd) it may still be initializing interfaces. Add a
little sleep for that.
 2019-12-05 23:31:15 +01:00
Marek Marczykowski-Górecki
ffa1a40e6e
tests/network: improve error reporting 
Include stdout/stderr of failed command during netvm setup.
 2019-12-05 23:31:15 +01:00
Marek Marczykowski-Górecki
8603571cbc
tests: skip networking tests for minimal templates 
Minimal templates don't have networking packages installed by default.
 2019-10-28 03:30:49 +01:00
Marek Marczykowski-Górecki
a1dabfefa0
tests: fix network re-attach tests 
On slow systems (OpenQA), 5s isn't enough. Instead of hardcoding some
timeout, simply wait for the full VM startup.
 2019-10-13 05:58:50 +02:00
Marek Marczykowski-Górecki
66de41ac26
tests: use pkill instead of killall 
killall isn't installed by default
 2019-04-13 16:42:37 +02:00
Marek Marczykowski-Górecki
357231ca8f
tests: network reconnect after network provider shutdown/crash 
QubesOS/qubes-issues#3642
 2019-02-27 06:03:57 +01:00
Marek Marczykowski-Górecki
9f6c97596d
tests: updates-available notification 
First install test-pkg-1.0, then add test-pkg-1.1 to repo and check if
updates-available flag is set. Then install updates and check if the
flag is cleared.

QubesOS/qubes-issues#2009
 2018-12-05 06:19:34 +01:00
Marek Marczykowski-Górecki
cea9f66bc3
tests/network: reduce code duplication 2018-12-05 05:42:15 +01:00
Marek Marczykowski-Górecki
4742a630f2
tests: use iptables --wait 
QubesOS/qubes-issues#3665 affects also tests...
 2018-10-27 16:44:53 +02:00
Marek Marczykowski-Górecki
e244c192ae
tests: use /bin/uname instead of /bin/hostname as dummy output generator 
Use something included in coreutils installed everywhere.
 2018-10-27 16:44:53 +02:00
Marek Marczykowski-Górecki
a972c61914
tests: use socat instead of nc 
socat have only one variant, so one command line syntax to handle. It's
also installed by default in Qubes VMs.
 2018-10-27 16:44:53 +02:00
Marek Marczykowski-Górecki
3f5618dbb0
tests/integ/network: make the tests independend of default netvm 
Network tests create own temporary netvm. Make it disconnected from the
real netvm, to not interefere in tests.
 2018-10-15 00:39:32 +02:00
Marek Marczykowski-Górecki
15140255d5
tests/integ/network: few more code style improvement 
Remove unused imports and unused variables, add some more docstrings.
 2018-10-15 00:38:38 +02:00
Marek Marczykowski-Górecki
375688837c
tests/integ/network: add type annotations 
Make PyCharm understand what mixin those objects are for.
 2018-10-15 00:30:17 +02:00
Marek Marczykowski-Górecki
8dab298b89
tests: create testcases on module import if environment variable is set 
If QUBES_TEST_TEMPLATES or QUBES_TEST_LOAD_ALL is set, create testcases
on modules import, instead of waiting until `load_tests` is called.
The `QUBES_TEST_TEMPLATES` doesn't require `qubes.xml` access, so it
should be safe to do regardless of the environment. The
`QUBES_TEST_LOAD_ALL` force loading tests (and reading `qubes.xml`)
regardless.

This is useful for test runners not supporting load_tests protocol. Or
with limited support - for example both default `unittest` runner and
`nose2` can either use load_tests protocol _or_ select individual tests.
Setting any of those variable allow to run a single test with those
runners.

With this feature used together load_tests protocol, tests could be
registered twice. Avoid this by not listing already defined test classes
in create_testcases_for_templates (according to load_tests protocol,
those should already be registered).
 2018-10-10 00:08:29 +02:00
Marek Marczykowski-Górecki
f8d17012c3
tests: fix loading tests for templates 
Fix #209
 2018-07-15 21:57:34 +02:00
Marek Marczykowski-Górecki
39a9e4e422
Merge remote-tracking branch 'qubesos/pr/209' 
* qubesos/pr/209:
  qubes/tests: change globals= to module= and fix syntax errors
  qubes/tests: use loadTestsFromNames for nose2 compat
 2018-04-30 01:13:11 +02:00
Wojtek Porczyk
843bbdb2c5 qubes/tests: change globals= to module= and fix syntax errors 2018-04-24 18:30:55 +02:00
Marek Marczykowski-Górecki
3726692530
tests: skip tests using netcat when it isn't installed 2018-04-05 01:28:54 +02:00
Wojtek Porczyk
dfe7688158 qubes/tests: use loadTestsFromNames for nose2 compat 2018-03-30 03:05:01 +02:00
Marek Marczykowski-Górecki
3fa0972317
tests: fix (system) network tests after switching to ipaddress module 2017-12-23 16:43:24 +01:00
Marek Marczykowski-Górecki
f3cf58e6f2
tests: add integration tests for IPv6 
Run also all IPv4 tests with IPv6 enabled to check for regressions
(broken IPv4 because of enabled IPv6).

QubesOS/qubes-issues#718
 2017-12-07 01:40:30 +01:00
Marek Marczykowski-Górecki
4d6bfbab4d
tests: improve spoof_ip test 
Not only check if full round trip ping (does not) work, but also if just
echo-request get filtered.
 2017-12-05 17:40:30 +01:00
Marek Marczykowski-Górecki
379add52ba
tests: skip network tests on whonix-gw and whonix-ws 
whonix-ws also have non-standard firewall and require specific tests for
that.
 2017-12-05 17:39:34 +01:00
Marek Marczykowski-Górecki
511502ae7e
tests: fix reporting in network tests 
Do not trash stdout with VM's command output. Log it as part of
(potential) failure message.
 2017-10-21 04:06:15 +02:00
Marek Marczykowski-Górecki
2164a8d7b8
Change license to LGPL v2.1+ 
See this thread for reasoning and acceptance from contributors:
https://groups.google.com/d/topic/qubes-devel/G7KzrfU0lWY/discussion
"Changing qubes-core-admin license to LGPL v2.1+"
 2017-10-12 00:11:50 +02:00
Marek Marczykowski-Górecki
6990550884
tests: more tests fixes, drop expectedFailure where not needed anymore 2017-10-04 15:24:52 +02:00
Marek Marczykowski-Górecki
cbc5dbb9b1
tests: various fixes 
- Use proper features/services names (updates proxy test).
- Fix logic error in wait_for_window.
- Fix test for qvm-sync-clock (first sync clockvm, then dom0), also fix
  cleanup (unset clockvm before removing it)
- More fixes for asyncio usage
 2017-10-04 15:24:52 +02:00
Marek Marczykowski-Górecki
9172a7708d
tests: fix various object leaks cont 
Do not use self.fail when handling exception - this will keep exception
object referenced, which in turn have reference to domain object (via
traceback).
 2017-09-29 11:53:59 +02:00
Marek Marczykowski-Górecki
f9da1f2dd7
tests: various fixes for networking tests 
- Update feature name for enabling network-manager.
- Fix error reporting
 2017-09-29 11:53:59 +02:00
Marek Marczykowski-Górecki
fdf780aad0
tests/network: match vm names with variable names 
Having testvm1 variable for "vm2" is really confusing.
 2017-09-29 11:53:59 +02:00
Marek Marczykowski-Górecki
d96d4a94e1
tests: various fixes 
- Fix str/bytes
- Call skipTest as early as possible - before doing any setup
- Fix networking tests - configuration commands needs to be called as
root (missing user= argument).
- Fix setting firewall - policy is no longer changeable
 2017-09-29 11:53:58 +02:00
Marek Marczykowski-Górecki
687ca4092c
tests: various fixes to integration tests 
Mostly add missing self.loop.run_until_complete().
 2017-09-05 02:01:58 +02:00
Wojtek Porczyk
25670fbd61 qubes.tests.list_templates(), and .close() the app 2017-08-31 20:30:23 +02:00
Marek Marczykowski-Górecki
801d6acf5c
Rename 'net/*' features to 'net.*' 
Same reasoning as with 'service/*' - '/' is not allowed in qrexec (so
Admin API) call argument.

Related to QubesOS/qubes-issues#2906
 2017-07-18 03:50:02 +02:00
Bahtiar `kalkin-` Gadimov
3be7b23f46
When running tests clean up and remove qubesd.socket 
Changed the inheritance hierarchy:

1. Renamed `SystemTestsMixin` to `SystemTestCase`
2. `SystemTestCase` is a child of `QubesTestCase`
3. All classes extending the prior `SystemTestsMixin` now just extend `object`
 2017-07-14 14:54:04 +02:00
Marek Marczykowski-Górecki
51a17ba749
tests: do not reload qubes.xml 
In core3 this isn't needed anymore (and unit tests already check if
that's really true).
 2017-06-21 00:17:42 +02:00
Wojtek Porczyk
dc793be81f Fixes from marmarek's review 2017-06-01 12:31:14 +02:00
Wojtek Porczyk
b256af3bfb qubes.tests asyncio 
QubesOS/qubes-issues#2622
 2017-05-29 17:34:15 +02:00
Marek Marczykowski-Górecki
9ace4e66f1
tests: more py3k related fixes 2017-02-27 02:37:49 +01:00
Marek Marczykowski-Górecki
9cad353939
tests: py3k related fixes - bytes/str 
Adjust usage of bytes vs str type.
 2017-02-27 02:35:49 +01:00
Wojtek Porczyk
d74567d65f qubes: port core to python3 
fixes QubesOS/qubes-issues#2074
 2017-01-20 16:42:51 +01:00