TDL

Tests Description Language 测试描述语言，用于描述测试用例，测试步骤等

目标特性

Schema 0.1

一个脚本一个Suite/Module/Epic

引用:
- 变量引用: $var或${var}
- 函数引用: $func()或${func()}
- 计算: ${var+1}、${func()+1}
文件导入
- 绝对路径: /tmp/tmp.log
- 项目路径: @/utils/utils.py
- 相对路径: ./db.py

# 配置<dict>
config: 
  base_url: 

# 用例<list>
tests:  
  - name: 用例描述
    tags: 用例标签 <list>
    skip: true
    xfail: true

模型设计

TestCase
Step
Data
TestSuite
TestReport

{
  "name": "testsuite_01",
  "description": "testsuite description",
  "filter": {
    "tags": [],
    "priorities": [],
    "status": [],
    "owner": []
  },
  "tags": [],
  "priority": 0,
  "setup": [],
  "teardown": [],
  "setup_suite": [],
  "teardown_suite": [],
  "tests": [
    {"id": "testsuite_01", "name": "testcase_01"},
    {"id": "testsuite_02", "name": "testcase_02"},
    {"id": "testsuite_03", "name": "testcase_03"}
  ]
}

测试用例

TestCase

feature
title/ scenario / summary
description: Optional[str]
tags
priority
status: 实现中/Ready 当前状态
timeout: 可继承运行参数
owner
ddt：可继承运行参数
setup
teardown
skip: 跳过条件
xfail：预期失败
rerun / retry/ repeat /times: 失败重试/无条件重试(repeat) 可继承运行参数
上次运行状态/时间总体状态 / 平均执行时间
state: 关联阶段 Prod/Test/Stage
type: 用例类型接口/性能/WebUI/AppUI
related_requirement：关联需求
order执行顺序

用例

{
  "name": "test_api_demo",
  "description": "test description",
  "priority": 1,
  "tags": ["http", "api-test"],
  "timeout": 100,
  "setup": [
    {"method": "Http.Get", "args": {"url": "/get","params":  {"a": 1, "b": 2, "c": 3}}}
  ],
  "teardown": [
     {"method": "Http.Get", "args": {"url": "/get","params":  {"a": 1, "b": 2, "c": 3}}}
  ],
  "steps": [
    {"method": "Http.Get", "args": {"url": "/get","params":  {"a": 1, "b": 2, "c": 3}}},
    {"method": "Http.Post", "args": {"url": "/post", "json":  {"name": "Kevin"}}},
    {"method": "Http.Get", "args": {"url": "/get", "params":  {"a": 1, "b": 2, "c": 3}}, 
      "store": {"url": "$.url"}, "excepted": {"eq": ["$url", "/get"]}}
  ]
}

{
  "name": "test_web_ui_demo",
  "description": "test description",
  "steps": [
    {"method": "Page.Open", "args": ["https://www.baidu.com/"]},
    {"method": "Page.InputTo", "args": ["id","kw", "helloworld"], "register": {"value1": "//[@id=\"kw\"]/@value"}},
    {"method": "Page.Click", "args": ["id","su"]}
  ]
}

{
  "name": "test_ssh_demo",
  "description": "test description",
  "steps": [
    {"method": "SSH.Execute", "args": "echo hello"},
    {"method": "SSH.GET", "args": ["/path/a.txt", "/local_path/a.txt"]}
  ]
}

{
  "name": "test_mysql_demo",
  "description": "test description",
  "steps": [
    {"method": "MySQL.Query", "args": "SELECT * FROM `users`"},
    {"method": "MySQL.Execute", "args": "INSERT INTO `users` (\"name\") VALUES(\"KEVIN\")"}
  ]
}

TestReport

{
  "name": "test_report",
  "summary": {
    "start_at": "2015-02-03 12:00:00.000",
    "end_at": "2015-02-03 12:01:00.00",
    "total": 12
  },
  "details": [
    {}
  ]
  
}

RF TestCase [Documentation] Used for specifying a test case documentation. [Tags] Used for tagging test cases. [Setup] Used for specifying a test setup. [Teardown] Used for specifying a test teardown. [Template] Used for specifying a template keyword. [Timeout]

测试步骤

TestStep

所属用例
顺序 order
执行动作
wait_for: 等待某一条件达到再开始执行
skip: 跳过条件
ignore_error: 忽略异常
except_error: 期望异常
on_error: continue / warn / raise
on_fail: continue / warn / fail
rurun / retry/ repeat / times / loop_util: 失败/永远执行次数 /直到
timeout: 超时时间
validate/ verify / check /assert
extract/ register / log 打印其中信息

并行和串行 steps

step1
step2 # 串行
[step3, step4] # 并行
支持基本的关联及断言
支持

问题

一个文件一个特性？一个套件？一个用例？

hanzhichao/tdl

TDL