TIP: Please make sure to read Getting started with programming tasks first.
You can start with our sample project that can be found on GitHub:
The project will be executed with the following command:
npm install && npm test
When compressing the project contents into a ZIP archive please skip ./node_modules directories.
It is possible to automatically assess the solution posted by the candidate. Automatic assessment is based on unit tests results and code quality measurements.
There are two kinds of unit tests:
- Candidate tests - unit tests that the candidate can see during the test should be used only for basic verification and to guide the candidate in understanding the requirements of the project. Candidate tests WILL NOT be used to calculate the final score.
- Verification tests - unit tests that the candidate can’t see during the test. Files containing verification tests will be added to the project after the candidate finishes the test and will be executed during the verification phase. The results of the verification tests will be used to calculate the final score.
Once the solution is developed and submitted, the platform executes verification tests and performs static code analysis.
Devskiller project descriptor
Programming tasks can be configured with the Devskiller project descriptor file:
- Create a devskiller.json file.
- Place it in the root directory of your project.
Here is an example project descriptor:
"readOnlyFiles" : [ "package.json", "test/**" ]
You can find more details about the
devskiller.json descriptor in our documentation.
Automatic verification with verification tests
The solution submitted by the candidate may be verified using automated tests. You’ll just have to define which tests should be treated as verification tests.
All files classified as verification tests will be removed from the project prior to inviting the candidate.
To define verification tests, you need to set two configuration properties in
- testNamePatterns - an array of RegEx patterns which should match all the names of the verification tests.
- pathPatterns - an array of GLOB patterns which should match all the files containing verification tests. All the files that match defined patterns will be deleted from candidates' projects and will be added to the projects during the verification phase. These files will not be visible to the candidate during the test.
In our sample project all verification tests are in a test suite are prefixed with
verify_pack string and are located in files under
verify_pack directory. In this case the following will suffice:
"testNamePatterns" : [".*verify_pack.*"],
NOTE: Please make sure to add the configuration for the JUnit reporting to your custom project. This part is required, because we are reading information about tests result from JUnit report file, this file should be named
test-results.xml . You can find the example of it in our sample project.