Code

Update to flash-attn2#149

Code

Open

Ding3LI wants to merge 2 commits intobowang-lab:mainbowang-lab/scGPT:mainfrom

Ding3LI:update-flash_attn2Ding3LI/scGPT:update-flash_attn2Copy head branch name to clipboard

Commits

Commits on Jan 23, 2024

• Modified scgpt/model/model.py & scgpt/model/multiomic_model.py for flash-attn2. Updated README.md with flash-attn2 installation and notes

  

  Henry Ding

  authored and

  Henry Ding

  committed
  0a4c75b

  Copy full SHA for 0a4c75b

Commits on Feb 2, 2024

• Updated flag::use_flash_attn to False in Multi-Head Attention because using padding_mask

  

  Henry Ding

  authored and

  Henry Ding

  committed
  5d29fb8

  Copy full SHA for 5d29fb8