Skip to content

Sliding Window Attention is enabled but not implemented for sequence_parallel_attention; unexpected results may be encountered. #73

@sherlock1987

Description

@sherlock1987

Reminder

  • I have read the README and searched the existing issues.

System Info

您好,感谢这份开源框架,帮助我们在工作中解决了很多的问题。首先以不是报错,而是warning,内容为:Sliding Window Attention is enabled but not implemented for sequence_parallel_attention; unexpected results may be encountered.

warning的地址发生在transformers model qwen2 的里面,请问这个warning是否影响最终的效果呢?

Reproduction

warning地址为:Library/Python/3.9/lib/python/site-packages/transformers/models/qwen2/modeling_qwen2.py

Expected behavior

No response

Others

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions