42% of integration tests don't pass
ProducerMatt opened this issue · 2 comments
ProducerMatt commented
Admittedly this number is exaggerated. The majority of failures come from Question-related modules, which I don't have API keys for and therefore can't work.
ProducerMatt commented
What is this? Is it supposed to be getting a DDG definition?
`TEST #6: FAILED`
The sent message was: "TEST_MESSAGE 6: what is deep learning?"
The expected message was "RegEx: Deep learning is part of a broader family of machine learning method"
The received message was "Perhaps this can answer your question? https://aisafety.info?state=8XBK_"
Aprillion commented
yup, a test from duckduckgo, you can search for "what is deep learning?" in the code:
Lines 123 to 124 in 1129a10
not sure what would be a reliable test that wouldn't be overruled by other modules in the future - feel free to delete fragile tests for now if you won't figure out how to replace them with something more stable 🤔