release: gloas#795
Open
mattevans wants to merge 83 commits into
Open
Conversation
…928 support fix(proto): implement proper handling of Gloas beacon blocks and their fields refactor(block_access_list.go): add functionality to decode and process block access list data from Gloas blocks fix(execution_transaction.go): adjust processing logic to handle transactions in Gloas blocks fix(beacon_blob.go): modify kzg commitments extraction for Gloas blocks to ensure proper retrieval fix(proposed_validator_block.go): update logic to correctly compute Gloas block size and handle transactions
feat(canonical): add ExecutionPayloadSlotNumber to canonical block batch fix(beacon): update GloasBlock message retrieval to use GetMessage method fix(event-ingester): fix casting of GloasBlock message to use GetMessage method test: add tests for BlockAccessList related functionalities style: reorder imports for clarity in conversion test file chore: refactor existing append functions to include ExecutionPayloadSlotNumber handling
Implement BeaconBlockAccessList type for handling access list events in the ETH V2 protocol. This adds support for new event type, enhances event routing, and allows for better structuring of events in the system.
…r improved stability chore(go.mod): update github.com/ethpandaops/beacon dependency to version v0.67.1 chore(go.sum): update checksum for the new github.com/ethpandaops/beacon version style(block_access_list.go): remove unnecessary empty line for cleaner code readability
… to ensure compatibility and access to bug fixes chore(go.sum): update checksum for ethpandaops/beacon to match new version
…or improved functionality fix(go.mod): change ethcore version to v0.0.0-20260323002709-50f492685a52 for compatibility fix(go.sum): update checksums for go-ethereum, c-kzg-4844, and ethcore dependencies fix(conversion.go): update access.Code to access.CodeChanges for clarity in block access list creation fix(conversion_test.go): adjust test to set CodeChange correctly in the test setup for block access list
… in Kafka and ClickHouse This change enhances the data pipeline by adding the beacon block access list event transformation and corresponding sinks, enabling better handling of this specific event data for analytics and processing downstream.
refactor: bals structure rlp decoded
… properties to use camelCase style(vector-kafka-clickhouse.yaml): standardize field naming conventions to match expected API format
…better customization
* master: chore(buf.yaml): update linting rules to exclude specific checks for better customization
…d storage read tracking fix(conversion): adjust handling of storage reads to use new BlockAccessListStorageRead structure
feat(gloas): add BAL storage reads and bump deps to bal-devnet-3
… with no state changes to enhance parallel execution analysis feat(proto): update BlockAccessListChange to include "touched" in change_type options for better clarity on account status
feat(gloas): add BAL storage reads and touched accounts
feat: prepare epbs types
…ClickHouse tables to improve data structure for valid bid tracking and payload attestation flow feat(migrations): create various new tables for tracking execution payloads, bids, and proposer preferences to enhance transaction handling and performance fix(migrations): reverse EIP-7732 changes in down scripts to ensure consistent rollback functionality and data integrity
feat(migrations): add epbs support
…BS conditional block routing
…): remove execution payload logic for Gloas blocks to simplify the code base and adapt to new event handling requirements
… execution payload and proposer preferences. feat(libp2p): add event names for libp2p Gossipsub events to manage payload attestation and proposer preferences. fix(routes_test): remove deprecated events from test coverage related to pending routes for ePBS. refactor(canonical): implement flattening methods for execution payload bid, payload attestation, and beacon block related events.
feat: beacon_synthetic_* events
feat: PTC vote three-state breakdown + EIP-7843 slot_number coverage
feat: add OnPayloadAttestationProcessed observe hook
* master: chore: swap go-eth2-client to ethpandaops fork v0.1.2 (#828) feat(output): add s3blobstore sink for blob sidecar archival
Bumps: - go-ethereum replace pin: bal-devnet-3 (8f361e342cb9, 2026-03-23) → bal-devnet-6 HEAD (73944e329925, 2026-05-07). Matches the EL branch deployed on glamsterdam-devnet-3 per ethpandaops/glamsterdam-devnets ansible inventory. - ethpandaops/beacon: 0260912 → ddfa770 (carrying matching go-ethereum pin). - ethpandaops/ethcore: 4e1b5fb → f67d7a6 (carrying matching go-ethereum pin + new eth.NewPeer 5-arg call). bal-devnet-6 keeps AccountAccess.StorageChanges + EncodedStorage.ToHash required by pkg/proto/eth/v1/conversion.go and brings the latest BAL (EIP-7928) refinements plus Amsterdam slot-number support (EIP-7843).
Resolves enum + migration collision by shifting BAL+ePBS up by 1:
- BEACON_API_ETH_V1_EVENTS_FAST_CONFIRMATION keeps event enum 89, oneof
field 95, oneof data field 210, and migration 002.
- BEACON_API_ETH_V2_BEACON_BLOCK_ACCESS_LIST moves 89 → 90 (oneof 96/211,
migration 003).
- All 15 ePBS enums shift up by 1 (90 → 91 ... 104 → 105) with matching
oneof field renumbering.
Accepts master's consumoor-only local stack (deletes vector-http-kafka.yaml
and vector-kafka-clickhouse{,-libp2p}.yaml; adds xatu-consumoor service
config + xatu-server direct kafka output with topicPattern
"xatu-protobuf-${event-name}").
Bumps ethpandaops/beacon to release/gloas tip 81b9ef3 to pick up both ePBS
SSE hooks (release/gloas) and OnFastConfirmation (merged in from master).
# By Sam Calder-Mason # Via GitHub * master: feat(observability): full OTel traces with gRPC propagation (#835) # Conflicts: # pkg/proto/eth/v2/events_vtproto.pb.go # pkg/sentry/event/beacon/eth/v1/beacon_blob.go # pkg/sentry/event/beacon/eth/v1/beacon_committee.go # pkg/sentry/event/beacon/eth/v1/events_attestation.go # pkg/sentry/event/beacon/eth/v1/events_blob_sidecar.go # pkg/sentry/event/beacon/eth/v1/events_block.go # pkg/sentry/event/beacon/eth/v1/events_block_gossip.go # pkg/sentry/event/beacon/eth/v1/events_chain_reorg.go # pkg/sentry/event/beacon/eth/v1/events_contribution_and_proof.go # pkg/sentry/event/beacon/eth/v1/events_data_column_sidecar.go # pkg/sentry/event/beacon/eth/v1/events_finalized_checkpoint.go # pkg/sentry/event/beacon/eth/v1/events_head.go # pkg/sentry/event/beacon/eth/v1/events_single_attestation.go # pkg/sentry/event/beacon/eth/v1/events_voluntary_exit.go # pkg/sentry/event/beacon/eth/v1/proposer_duty.go
… consistency and to avoid unnecessary conversion
feat: port otel work to glammy work
* master: fix(processor): stop per-trace partitioning in BatchItemProcessor (#841)
feat: decode Gloas data_column_sidecar gossip events
… dependencies and reasons for the pinning to bal-devnet-6
refactor: glammy-devnet-4 prysm renamed fields
…ypes for consistency with the new API design This change modifies the event constant names and proto types, ensuring they align with the updated API structure. The changes improve clarity and foster easier integration and maintenance of the event ingestion system. refactor(proto): reorder fields in event_ingester.pb.go for improved organization and readability. This change enhances the maintainability of the code by establishing a more logical structure. refactor(proto): rename fields in Event message for clarity and consistency fix(proto): update method signatures in event_ingester_vtproto for renamed fields to match updated Event message structure
…TxIndex to ensure correct value representation in BlockAccessList
Resolves the 48-commit drift between release/gloas and master: - proto enum/field renumbering: master's cannon-cryo and Fulu event IDs are frozen (deployed); all gloas ePBS/BAL event IDs, AdditionalData oneof fields, DecoratedEvent data oneof fields, CannonTypes and CannonLocation oneof fields move above master's ranges. Regenerated all .pb.go via buf. - gloas cannon derivers (block access list, payload attestation, execution payload bid) adapted to master's layer-grouped deriver config (Derivers.Consensus.*) and re-registered in cannon.go. - gloas migrations re-authored into the per-schema layout as xatu/006_gloas_bals_support and xatu/007_gloas_epbs_support, converted to the database-agnostic convention (no default. prefix, Distributed(..., currentDatabase(), ...)). - event categorizer test counts updated for the 7 gloas events on top of master's 27. - envelope cache wired to the nested Beacon.BlockCacheTTL config.
…evnet-6) Bump ethpandaops/go-eth2-client to v0.1.5 and adapt to the spec changes between devnet-4 (alpha.8) and devnet-6 (alpha.11): - ProposerPreferences.gas_limit renamed to target_gas_limit (consensus-specs #5235), through proto, conversions, ClickHouse columns and routes. - EIP-8282 builder execution requests (#5359): execution requests proto gains builder_deposits/builder_exits, converted from the gloas-local ExecutionRequests container now carried by ExecutionPayloadEnvelope and gloas blocks. - Execution request derivers adapted to the versioned VersionedExecutionRequests accessor API. - canonical_beacon_block_withdrawal route now writes withdrawal_type (validator|builder), which the deriver already populated. - canonical_beacon_block_access_list gains the standard meta_consensus_version_major/minor/patch columns.
Replaces the TODO(epbs) placeholders with realistic Gloas payloads (devnet-6 flavored values) and payload-specific column assertions for the sentry SSE, cannon-derived, gossipsub and synthetic event routes.
Found by running sentry + cannon + the full local pipeline against the live devnet (the first devnet run for the cannon side): - canonical_beacon_block route: accept Gloas blocks in the identity field dispatch (strict-validate halted every canonical block flush). - eth_v3_validator_block route: accept Gloas proposed blocks (no inline execution payload; payload columns legitimately empty). - cannon + sentry beacon block events: Gloas bodies carry no transactions (they live in the envelope) — record zero body-tx stats instead of erroring/warning per block. - execution transaction deriver: blob sidecars are best-effort from Gloas (reconstruction from columns is unreliable across clients) — never block the transaction dataset on them. - bump go-eth2-client to the envelope JSON-unwrap fix (ethpandaops/go-eth2-client#36); without it cannon could not fetch any execution payload envelope over JSON.
release: gloas (glamsterdam-devnet-6)
Bumps go-eth2-client for the eventstream fix: lighthouse wraps payload_attestation_message / execution_payload_bid / proposer_preferences per spec, prysm sends the bare object; both now decode.
fix(gloas): accept versioned wrapper on gloas SSE events
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Glamsterdam fork support to Xatu.
What this covers
EIP-7928 — Block-Level Access Lists (BALs)
Spec-compliant against
bal-devnet-3.BlockAccessList,BlockAccessListEntry,BlockAccessListChange,BlockAccessListStorageRead(incl."touched"change type for accounts with no state changes)BeaconBlockGloas/BeaconBlockBodyGloasproto messagesExecutionPayloadGloaswithblock_access_list+slot_numberBEACON_API_ETH_V2_BEACON_BLOCK_ACCESS_LIST = 89NewBlockAccessListFromGloas()(with test coverage)NewBlockAccessListDeriver(CannonType 16) — wired002_gloas_bals_support(tablecanonical_beacon_block_access_list+execution_payload_block_access_list_rootcolumn oncanonical_beacon_block)NewEventBlockFromGloas()EIP-7732 — Enshrined Proposer-Builder Separation (ePBS)
Internal plumbing wired end-to-end across server, sentry, cannon, fork-choice. Awaiting Gloas devnet for integration testing.
eth/v1files (incl.execution_payload_available.proto), 4 libp2p gossipsub summary types, 12 new event IDs (90–101), 12Additional*Datamessages, 3 newCannonTypeentries (16/17/18)003_gloas_epbs_support— 12 new tables + column additions (builder_index,bid_value,execution_payment,payload_present)event.go(incl. new GOSSIP / AVAILABLE handlers)OnExecutionPayload,OnExecutionPayloadGossip,OnExecutionPayloadAvailable,OnExecutionPayloadBid,OnPayloadAttestationMessage,OnProposerPreferencesNewPayloadAttestationDeriver,NewExecutionPayloadBidDeriver; backfilling checkpoint iterator handles CannonType 16/17/18 in bothGetMarkerandcreateLocationFromEpochNumberForkChoiceNodeV2.payload_statusround-trips viaextra_data["payload_status"]pkg/clickhouse/route/{beacon,canonical,libp2p}/What this does NOT yet cover
Devnet-blocked or out-of-scope:
pkg/clmimicry/) — server handlers and routes already exist; producer side is the gapExecutionTransaction/Withdrawal/BlockAccessList— depends onBeaconBlockBodyGloasno longer carryingExecutionPayload; wired onceenvelope events arrive on devnet
nil … payload: invalid eventawaiting Gloas devnet dataOnBlock/OnHeadGloas paths) — wire once devnet stabiliseseth_getBlockAccessListJSON-RPC, Engine API V5/V6 tracking (newPayloadV5,getPayloadV6,forkchoiceUpdatedV4)Intentionally not included (don't reintroduce without spec confirmation)
payload_voteprojection on attestation tables —committee_indexalready stores rawdata.index; consumers can derive 0/1 for Gloas+ rowssidecar_slot/sidecar_beacon_block_rootprojections on DataColumnSidecar tables — preemptive; revisit when real Gloas SSE payloads arriveMigrations
002_gloas_bals_support003_gloas_epbs_support