Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
230 commits
Select commit Hold shift + click to select a range
37d4e52
sketch
mattbit Jun 9, 2025
cd0a449
basic draft
mattbit Jun 9, 2025
b080af3
Add readme
mattbit Jun 10, 2025
d27ada1
Working on tools
mattbit Jun 10, 2025
52559c0
Tools
mattbit Jun 10, 2025
2060b34
working on pipeline with tools
mattbit Jun 11, 2025
f8abeab
Add cursor rule
mattbit Jun 11, 2025
2e91e73
add pylint-pydantic
mattbit Jun 11, 2025
8e57abe
use default params in generator
mattbit Jun 11, 2025
4765753
Simple implementation of multi message templates
mattbit Jun 12, 2025
b03a15d
Better implementation of the prompt manager
mattbit Jun 12, 2025
3419212
Render pydantic models as json
mattbit Jun 12, 2025
0bb3aca
feat: added rate limiter (#1)
kevinmessiaen Jun 12, 2025
aef48b9
feat: output parsing and instructions
mattbit Jun 12, 2025
17a3c6c
chore: add tests for chat output
mattbit Jun 12, 2025
9e1ec60
Add tests
mattbit Jun 12, 2025
fdf4731
update ci
mattbit Jun 12, 2025
8c9209d
formatting and cleanup
mattbit Jun 12, 2025
ff7083a
Adding ruff
mattbit Jun 12, 2025
91bcd2f
fix: only include output instructions if model is available
mattbit Jun 12, 2025
9b9bcd5
chore: use gemini 2.0 flash for tests
mattbit Jun 12, 2025
fe2e24f
chore: update deps
mattbit Jun 12, 2025
be9273e
chore: update package description
mattbit Jun 12, 2025
7fc2d7f
fix: adapt tool decorator to work with class methods
mattbit Jun 12, 2025
27b505c
feat: add run context for tools (#2)
mattbit Jun 13, 2025
f94eb45
chore: adding docs
mattbit Jun 13, 2025
5cd4058
fix: add template method in generator (#3)
pierlj Jun 13, 2025
09b4505
fix: mistake in readme
mattbit Jun 13, 2025
d9a696e
feat: enforce structured output (#4)
mattbit Jun 13, 2025
a329dce
feat: pass inputs to run context (#5)
mattbit Jun 13, 2025
eb38212
fix: basic error handling (#6)
mattbit Jun 13, 2025
cc6dddc
feat: reorganize generators with base class and mixins (#7)
mattbit Jun 16, 2025
21a3dd4
feat: add stream_many and stream_batch to get pipeline results as the…
mattbit Jun 16, 2025
b1c7ba7
Fix: Added missing finish reason (#10)
kevinmessiaen Jun 19, 2025
a43b949
Added temperature (#9)
kevinmessiaen Jul 1, 2025
51dbc49
fix: avoid deep copy of pipeline when not necessary (#13)
mattbit Jul 4, 2025
1241190
feat: better transcript for chats with tool usage (#11)
mattbit Jul 4, 2025
4367cae
fix: add text property to text message content (#15)
mattbit Jul 4, 2025
707433b
feat: add retry policy to generators (#12)
mattbit Jul 21, 2025
31df2e0
feat: add logfire to trace calls and improve debugging (#14)
mattbit Jul 25, 2025
c53589f
feat: add max tokens to generation params
mattbit Jul 25, 2025
239f8f2
Chore: [GSK-4541] Lower Python version requirement to support 3.10+ (…
kevinmessiaen Aug 4, 2025
f213c8a
Release workflow (#19)
kevinmessiaen Aug 5, 2025
0fc7a86
Release workflow
kevinmessiaen Aug 5, 2025
78e11c4
Release workflow (#21)
kevinmessiaen Aug 5, 2025
9627961
Release v0.1.2: Bump version to 0.1.2 (#22)
github-actions[bot] Aug 5, 2025
7b9be59
chore: Configure Renovate (#20)
renovate[bot] Aug 5, 2025
eebef35
chore(config): migrate config renovate.json (#27)
renovate[bot] Aug 5, 2025
671da20
chore(deps): update github-actions dependencies (#25)
renovate[bot] Aug 5, 2025
4328b24
chore(deps): update github-actions dependencies (#26)
renovate[bot] Aug 5, 2025
204da33
chore: Update renovate config (#28)
pierlj Aug 5, 2025
aeaf075
fix(deps): pin dependencies (#24)
renovate[bot] Aug 5, 2025
d2c81d0
feat: structured checks
kevinmessiaen Sep 4, 2025
d4486a9
chore: readme and docstring
kevinmessiaen Sep 4, 2025
215043f
fix: typing
kevinmessiaen Sep 4, 2025
0ed2e01
chore: Removed useless pyright ignore
kevinmessiaen Sep 4, 2025
69b6d39
chore: Reorganized export
kevinmessiaen Sep 4, 2025
2bf9136
fix: pytest warning on TestCase
kevinmessiaen Sep 4, 2025
9ff558e
chore: Added missing type hint on TestCase.run
kevinmessiaen Sep 4, 2025
d5cd61e
fix: skipped and passed when no test
kevinmessiaen Sep 4, 2025
cf085ba
feat: TestCase serialization
kevinmessiaen Sep 4, 2025
5e41b8b
feat: TestCase serialization handles import
kevinmessiaen Sep 4, 2025
bda3b05
chore: nits
kevinmessiaen Sep 4, 2025
08161b6
chore: Add license check and THIRD_PARTY_NOTICES.md [ENG-815] (#39)
kevinmessiaen Sep 4, 2025
ad704c0
chore(deps): update actions/checkout action to v5 (#34)
renovate[bot] Sep 4, 2025
45302c0
chore: Fixed readme
kevinmessiaen Sep 5, 2025
6ab98ef
feat: added chat interaction
kevinmessiaen Sep 5, 2025
e4fe4c2
chore: updated readme
kevinmessiaen Sep 5, 2025
0ad5302
feat: refactored workflow and error handling (#40)
mattbit Sep 5, 2025
c6edac6
Release v0.2.0: Bump version to 0.2.0 (#41)
github-actions[bot] Sep 5, 2025
a54154b
chore: relax dependency policy (#42)
mattbit Sep 5, 2025
d5ad1a8
Release v0.2.1: Bump version to 0.2.1 (#43)
github-actions[bot] Sep 5, 2025
735677e
chore: cursor config
kevinmessiaen Sep 8, 2025
3a10f71
chore: Added CODEMAP.md
kevinmessiaen Sep 8, 2025
6d663ff
refactoring
kevinmessiaen Sep 11, 2025
855b029
Adding extractor
kevinmessiaen Sep 11, 2025
94f1302
cleanup
kevinmessiaen Sep 11, 2025
28b4bc3
refactoring
kevinmessiaen Sep 11, 2025
0884066
refactoring
kevinmessiaen Sep 11, 2025
512b46a
refactoring
kevinmessiaen Sep 11, 2025
2630bd7
made counterpoint a dev dep
kevinmessiaen Sep 11, 2025
1545875
refactoring
kevinmessiaen Sep 11, 2025
279f398
improved error messages
kevinmessiaen Sep 11, 2025
2fb4eaa
refactoring
kevinmessiaen Sep 11, 2025
bc855e5
Merge pull request #1 from Giskard-AI/chore/refactoring
kevinmessiaen Sep 15, 2025
3e11857
chore: Removed counterpoint dev dep
kevinmessiaen Sep 15, 2025
09ffd34
chore: Added CI workflow
kevinmessiaen Sep 15, 2025
6d0d362
chore: Added Makefile
kevinmessiaen Sep 15, 2025
bfc0d07
chore: Updated doc to refere to makefile
kevinmessiaen Sep 15, 2025
8ceae8b
Merge pull request #2 from Giskard-AI/feature/eng-946-giskard-checks-…
kevinmessiaen Sep 15, 2025
34335ed
chore: Added renovate
kevinmessiaen Sep 15, 2025
d1940d1
feat: registry-only serialization
kevinmessiaen Sep 15, 2025
6deb777
Merge pull request #3 from Giskard-AI/feature/eng-948-giskard-checks-…
kevinmessiaen Sep 15, 2025
e027dd3
feat: support strict parsing [ENG-976] (#46)
mattbit Sep 18, 2025
8c9f996
Release v0.2.2: Bump version to 0.2.2 (#47)
github-actions[bot] Sep 18, 2025
9c26ada
chore: use wide dep range (#45)
kevinmessiaen Sep 30, 2025
8744615
chore(deps): update astral-sh/setup-uv digest to d0cc045 (#50)
renovate[bot] Oct 9, 2025
0dc510d
chore(deps): update softprops/action-gh-release digest to aec2ec5 (#51)
renovate[bot] Oct 9, 2025
db6a72a
chore(licence): Added licence info (#52)
kevinmessiaen Oct 9, 2025
7e04a8b
feat: namespaced templates (#49)
mattbit Oct 13, 2025
3a6476d
chore(deps): update softprops/action-gh-release digest to 6da8fa9 (#54)
renovate[bot] Oct 13, 2025
123a845
chore(deps): update dependency pytest to v8.4.2 (#55)
renovate[bot] Oct 13, 2025
3a0c813
Release v0.2.3: Bump version to 0.2.3 (#56)
github-actions[bot] Oct 13, 2025
7c69c5d
fix: make format fix linting (#9)
kevinmessiaen Oct 14, 2025
983961c
refactor: replace custom serialization with standard Pydantic methods…
kevinmessiaen Oct 14, 2025
025bdf8
chore: simplified Interactions (#10)
kevinmessiaen Oct 14, 2025
9f958a7
feat: Goundedness check [ENG-1045 | ENG-963] (#11)
kevinmessiaen Oct 14, 2025
7566889
feat: inline prompt checks (#12)
kevinmessiaen Oct 15, 2025
848dfbc
feat: assert pass utility (#13)
kevinmessiaen Oct 15, 2025
f0a11ab
refactor!: rename Interaction input/output to inputs/outputs (#14)
kevinmessiaen Oct 15, 2025
bcd9718
feat: Conformity Check [ENG-966] (#15)
kevinmessiaen Oct 15, 2025
50a71e5
feat: add assert_passed() shortcut method to TestCase (#16)
kevinmessiaen Oct 15, 2025
62337bd
fix(ci): more secure handling of CI variables (#53)
kevinmessiaen Oct 20, 2025
ff4bb37
feat: use jinja2 for inline prompt (#17)
kevinmessiaen Oct 23, 2025
9dfd027
fix(deps): update dependency logfire-api to v4 (#64)
renovate[bot] Oct 27, 2025
795d91f
chore(deps): update dependency ipykernel to v7 (#63)
renovate[bot] Oct 27, 2025
a4f4368
chore(deps): update astral-sh/setup-uv action to v7 (#61)
renovate[bot] Oct 27, 2025
be1a0d0
chore(deps): update dependency pytest-asyncio to v1.2.0 (#60)
renovate[bot] Oct 27, 2025
d8640bb
chore(deps): update dependency pylint-pydantic to v0.4.0 (#58)
renovate[bot] Oct 27, 2025
5efe67d
feat: Add dynamic interaction generators with context awareness and e…
kevinmessiaen Oct 27, 2025
ba3bd4a
chore: update dependencies (#21)
kevinmessiaen Oct 27, 2025
80974d7
refactor: Replace LLMCheck abstraction with modular base class [ENG-1…
kevinmessiaen Oct 27, 2025
bdfb682
ci: add Python 3.14 to test matrix (#22)
kevinmessiaen Oct 28, 2025
a96b601
chore(deps): update dependency pylint-pydantic to v0.4.1 (#66)
renovate[bot] Nov 3, 2025
e9dfc1b
chore(deps): update dependency ipykernel to v7.1.0 (#67)
renovate[bot] Nov 3, 2025
a18c962
feat: Update ruff add F401 unused import (#24)
kevinmessiaen Nov 4, 2025
1c1cd73
refactor!: rename package from counterpoint to giskard.agents (#62)
kevinmessiaen Nov 4, 2025
18b3341
Release v0.3.0: Bump version to 0.3.0 (#69)
github-actions[bot] Nov 4, 2025
b695f2a
fix(ci): add id-token write permission (#70)
kevinmessiaen Nov 4, 2025
7206738
refactor: migrate from giskard_checks to giskard.checks namespace (#20)
kevinmessiaen Nov 4, 2025
846beaf
refactor: migrate from counterpoint to giskard-agents namespace (#25)
kevinmessiaen Nov 4, 2025
1636661
fix(ruff): added back default F rule (#26)
kevinmessiaen Nov 6, 2025
6d26c5a
refactor(interactions): rename InteractionResult to Interaction and r…
kevinmessiaen Nov 6, 2025
1013da1
chore(deps): update softprops/action-gh-release digest to 5be0e66 (#71)
renovate[bot] Nov 10, 2025
e78b9f5
Initial commit
kevinmessiaen Nov 10, 2025
8486a7f
ci: add release workflow automation (#1)
kevinmessiaen Nov 10, 2025
cf7d6b0
docs: simplify README for giskard-core project (#2)
kevinmessiaen Nov 10, 2025
d21836a
fix(security): prevent code injection in GitHub Actions workflow (#59)
kevinmessiaen Nov 12, 2025
c324e86
chore(deps): update dependency pytest-asyncio to v1.3.0 (#74)
renovate[bot] Nov 17, 2025
7268131
chore(deps): update astral-sh/setup-uv digest to 5a7eac6 (#73)
renovate[bot] Nov 17, 2025
ad81811
chore(deps): update dependency pytest to v9 (#72)
renovate[bot] Nov 17, 2025
73a7685
feat: Allow discriminated subclasses (#3)
kevinmessiaen Nov 20, 2025
a86c876
Release v0.1.1: Bump version to 0.1.1 (#4)
github-actions[bot] Nov 20, 2025
84f48fd
fix(discriminated): allow subclass registration with intermediate bas…
kevinmessiaen Nov 24, 2025
3000774
Release v0.1.2: Bump version to 0.1.2 (#6)
github-actions[bot] Nov 24, 2025
144e591
fix(discriminated): improve subclass and generic type resolution (#7)
kevinmessiaen Nov 24, 2025
4962e18
Release v0.1.3: Bump version to 0.1.3 (#8)
github-actions[bot] Nov 24, 2025
8c49390
Fix: Restore Python 3.11 support (#9)
kevinmessiaen Nov 25, 2025
510342b
Release v0.1.4: Bump version to 0.1.4 (#10)
github-actions[bot] Nov 25, 2025
7858c04
chore: add MIT license (#11)
kevinmessiaen Nov 25, 2025
02311fc
feat: add license file and license checking infrastructure (#12)
kevinmessiaen Nov 25, 2025
338b215
feat: improve serialization (#13)
kevinmessiaen Nov 26, 2025
a83c525
Release v0.1.5: Bump version to 0.1.5 (#14)
github-actions[bot] Nov 26, 2025
84601d0
chore(deps): update actions/checkout action to v6 (#79)
renovate[bot] Dec 1, 2025
770fa24
chore(deps): update peter-evans/create-pull-request digest to 84ae59a…
renovate[bot] Dec 1, 2025
b157eca
chore(deps): update astral-sh/setup-uv digest to 1e862df (#76)
renovate[bot] Dec 1, 2025
01e3a2b
feat: scenario (#29)
kevinmessiaen Dec 3, 2025
e1f1774
fix: allow interaction inputs/outputs callable params to have default…
kevinmessiaen Dec 10, 2025
4a3d305
chore(deps): update astral-sh/setup-uv digest to ed21f2f (#81)
renovate[bot] Dec 10, 2025
8dcc159
fix bug with params overwrite (#80)
mattbit Dec 10, 2025
8c3a564
chore(deps): update actions/checkout digest to 8e8c483 (#75)
renovate[bot] Dec 10, 2025
d6a46f1
feat: Added isort and unused import linting and auto-fix (#68)
kevinmessiaen Dec 10, 2025
88e83ba
chore(deps): update peter-evans/create-pull-request digest to 22a9089…
renovate[bot] Dec 10, 2025
43df6c7
feat(templates): add LLMFormattable protocol for custom object format…
kevinmessiaen Dec 10, 2025
b135ce6
feat: [ENG-1210] immutable ChatWorkflow (#84)
educhesne Dec 12, 2025
cb890df
feat(generators): make generators serializable using discriminated un…
kevinmessiaen Dec 12, 2025
c8d89b4
chore(deps): update astral-sh/setup-uv digest to 681c641 (#85)
renovate[bot] Dec 15, 2025
67fd786
chore(deps): update dependency pytest to v9.0.2 (#87)
renovate[bot] Dec 15, 2025
e3d8825
chore(deps): update softprops/action-gh-release digest to a06a81a (#86)
renovate[bot] Dec 15, 2025
943082f
feat: detect and prevent conflicts with legacy giskard package (#15)
kevinmessiaen Dec 18, 2025
f7c5040
fix(rate-limiter): prevent deepcopy from creating duplicate instances…
kevinmessiaen Dec 19, 2025
e651b32
Release v0.3.1: Bump version to 0.3.1 (#90)
github-actions[bot] Dec 19, 2025
4b94fab
fix(discriminated): handle generic models with concrete type paramete…
kevinmessiaen Dec 19, 2025
6663fd9
Release v0.1.6: Bump version to 0.1.6 (#17)
github-actions[bot] Dec 19, 2025
535aefb
fix(validation): raise error for non-dict values in discriminated val…
kevinmessiaen Dec 19, 2025
20cf86d
Release v0.1.7: Bump version to 0.1.7 (#19)
github-actions[bot] Dec 19, 2025
21735f1
feat(generators): implement user simulator (#33)
kevinmessiaen Dec 19, 2025
c9b0529
feat(api): export all public classes from main package (#34)
kevinmessiaen Dec 22, 2025
5f08bd4
chore(deps): update peter-evans/create-pull-request action to v8 (#91)
renovate[bot] Dec 22, 2025
c8805fa
chore(deps): update dependency pip-audit to v2.10.0 (#88)
renovate[bot] Dec 22, 2025
d75138b
refactor(checks): standardize check names by removing 'Check' suffix …
kevinmessiaen Dec 24, 2025
f630fb8
feat!: pass trace object directly to Jinja2 templates (#36)
kevinmessiaen Dec 24, 2025
f561f25
feat: allow context to be single string in groundedness checks (#37)
kevinmessiaen Jan 7, 2026
4231192
feat: add shortcut to access last interaction (#38)
kevinmessiaen Jan 12, 2026
e43f76b
chore(deps): update astral-sh/setup-uv digest to 61cb8a9 (#93)
renovate[bot] Jan 12, 2026
e80ce1a
feat(scenarios): add builder pattern for user-friendly scenario creat…
kevinmessiaen Jan 14, 2026
0aa94f7
refactor(v3): remove legacy v2 codebase
kevinmessiaen Jan 15, 2026
2163a66
feat(v3): merge giskard-core into monorepo
kevinmessiaen Jan 15, 2026
c7d99f4
refactor(v3): move pre-commit config to repository root
kevinmessiaen Jan 15, 2026
031fe62
refactor(v3): move renovate config to repository root
kevinmessiaen Jan 15, 2026
922f171
feat(v3): merge giskard-agents into monorepo
kevinmessiaen Jan 15, 2026
bdf6efd
feat(v3): merge giskard-checks into monorepo
kevinmessiaen Jan 15, 2026
f82bc03
docs(v3): exclude internal packages from third-party notices
kevinmessiaen Jan 19, 2026
1249085
refactor: consolidate monorepo build configuration and dependencies
kevinmessiaen Jan 19, 2026
ec707c1
Add CI workflow for full test suite
kevinmessiaen Jan 19, 2026
ff70b24
chore: upgrade all deps (transitive) (#95)
Hartorn Jan 19, 2026
003e1cf
fix: making singleton behaviour not failing with pydantic (#94)
Hartorn Jan 19, 2026
dd085be
Release v0.3.2: Bump version to 0.3.2 (#96)
github-actions[bot] Jan 19, 2026
177e33b
Merge agents_origin/main: resolve conflicts from file moves and updates
kevinmessiaen Jan 19, 2026
aca0007
Add option to preserve context when cloning chat (#92)
pierlj Jan 20, 2026
e1a3634
Release v0.3.3: Bump version to 0.3.3 (#97)
github-actions[bot] Jan 20, 2026
de09319
Merge remote-tracking branch 'agents_origin/main' into feature/giskar…
kevinmessiaen Jan 20, 2026
c5753c0
chore: bump giskard-agents version to 0.3.3
kevinmessiaen Jan 20, 2026
8630566
feat: add documentation infrastructure with Sphinx
kevinmessiaen Jan 20, 2026
a2d9a49
docs(checks): simplify API surface in tutorials with fluent API focus
kevinmessiaen Jan 20, 2026
ca1a741
Merge pull request #2230 from Giskard-AI/feature/eng-1294-docs-simpli…
kevinmessiaen Jan 20, 2026
05c70ef
chore(docs): remove unused images from _static/images directory
kevinmessiaen Jan 20, 2026
b4903ea
docs: remove async wrappers from code examples
kevinmessiaen Jan 21, 2026
25c3627
fix: add --all-groups flag to uv sync
kevinmessiaen Jan 21, 2026
cabe76c
feature(checks): Improve string matching checks
kevinmessiaen Jan 22, 2026
4c4e7af
docs(string-matching): update documentation to match StringMatching i…
kevinmessiaen Jan 22, 2026
6179c9d
feat: rich display for results (#39)
kevinmessiaen Jan 22, 2026
d45c131
Merge pull request #2233 from Giskard-AI/feature/eng-1309-confirmadju…
kevinmessiaen Jan 23, 2026
c41132b
ci: update test run conditions based on project dependencies
kevinmessiaen Jan 23, 2026
a6e5d67
chore(deps): bump filelock from 3.20.0 to 3.20.3 (#41)
dependabot[bot] Jan 26, 2026
7968b0e
chore(deps): bump aiohttp from 3.13.0 to 3.13.3 (#42)
dependabot[bot] Jan 26, 2026
f46e97c
Merge remote-tracking branch 'checks_origin/main' into feature/giskar…
kevinmessiaen Jan 26, 2026
f0c3b02
feat(dep): add rich to giskard checks
kevinmessiaen Jan 26, 2026
0aa83e3
chore: add VSCode directory to gitignore
kevinmessiaen Jan 27, 2026
e44e3fc
chore(docs): remove documentation infrastructure
kevinmessiaen Jan 27, 2026
cd75b0a
Merge pull request #2235 from Giskard-AI/feature/eng-1304-giskard-oss…
mattbit Jan 27, 2026
8c9dddd
feature(checks): Add similarity check [ENG-1308] (#2232)
pierlj Feb 3, 2026
a533ffa
feat(check): Add Equality checks (#2234)
kevinmessiaen Feb 3, 2026
0230f78
chore(docs): align checks README and docstrings
kevinmessiaen Feb 3, 2026
8ef0437
chore(deps): bump workspace packages to 1.0.0a1 and use >=1.0.0a1
kevinmessiaen Feb 4, 2026
6ada999
docs(readme): rewrite for v3 alpha scope
kevinmessiaen Feb 4, 2026
81e424b
chore: ci workflows v3 (#2238)
mattbit Feb 5, 2026
1f094ef
Merge branch 'main' of github.com:Giskard-AI/giskard-oss into renovat…
Hartorn Feb 12, 2026
937615c
debug renovate
Hartorn Feb 12, 2026
c7f34aa
test change jinja2
Hartorn Feb 12, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 0 additions & 2 deletions .coveragerc

This file was deleted.

16 changes: 0 additions & 16 deletions .flake8

This file was deleted.

2 changes: 1 addition & 1 deletion .git-blame-ignore-revs
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@
7e9ea13e0d06f6d0a1cf1821ee39a08511d02f03
c75f43099c1fa1ee3863aa5d38eeaafa2f78d745
# iSort
f7bbe212aec81c3c4bd8aadff08080ab82d31cee
f7bbe212aec81c3c4bd8aadff08080ab82d31cee
3 changes: 0 additions & 3 deletions .gitattributes

This file was deleted.

2 changes: 1 addition & 1 deletion .github/CODEOWNERS
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
### Limit any modification to .github folder to have an owner review
.github @Giskard-AI/giskard
.github @Giskard-AI/giskard
4 changes: 0 additions & 4 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,6 @@

version: 2
updates:
- package-ecosystem: "npm"
directory: "/"
schedule:
interval: "monthly"

- package-ecosystem: "pip"
directory: "/"
Expand Down
67 changes: 67 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
name: CI

on:
push:
branches: [main]
pull_request:
workflow_dispatch:

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

jobs:
lint:
runs-on: ubuntu-latest
timeout-minutes: 10
steps:
- uses: actions/checkout@v4
- uses: astral-sh/setup-uv@v7
with:
enable-cache: true
python-version: "3.12"
- run: make install install-tools
- run: make check

test-unit:
needs: lint
runs-on: ubuntu-latest
timeout-minutes: 15
strategy:
fail-fast: false
matrix:
python-version: ["3.12", "3.13"]
package: [giskard-core, giskard-agents, giskard-checks]
name: test-unit / ${{ matrix.package }} / ${{ matrix.python-version }}
steps:
- uses: actions/checkout@v4
- uses: astral-sh/setup-uv@v7
with:
enable-cache: true
python-version: ${{ matrix.python-version }}
- run: make install
- run: make test-unit PACKAGE=${{ matrix.package }}

test-functional:
needs: lint
runs-on: ubuntu-latest
environment: CI
timeout-minutes: 30
strategy:
fail-fast: false
matrix:
python-version: ["3.12", "3.13"]
package: [giskard-core, giskard-agents, giskard-checks]
name: test-functional / ${{ matrix.package }} / ${{ matrix.python-version }}
env:
GEMINI_API_KEY: ${{ secrets.GEMINI_API_KEY }}
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
TEST_MODEL: "gemini/gemini-2.0-flash"
steps:
- uses: actions/checkout@v4
- uses: astral-sh/setup-uv@v7
with:
enable-cache: true
python-version: ${{ matrix.python-version }}
- run: make install
- run: make test-functional PACKAGE=${{ matrix.package }}
22 changes: 0 additions & 22 deletions .github/workflows/clear-cache.yml

This file was deleted.

129 changes: 0 additions & 129 deletions .github/workflows/create-release.yml

This file was deleted.

12 changes: 0 additions & 12 deletions .github/workflows/nightly-test.yml

This file was deleted.

25 changes: 0 additions & 25 deletions .github/workflows/pre-commit-checks.yml

This file was deleted.

20 changes: 0 additions & 20 deletions .github/workflows/retry-workflow.yml

This file was deleted.

8 changes: 4 additions & 4 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -76,9 +76,6 @@ instance/
# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/
Expand Down Expand Up @@ -174,4 +171,7 @@ catboost_info
generated
# npm
node_modules/
mlruns
mlruns

# VSCode
.vscode/
Loading
Loading