Fix: Add Transformers 4.47+ compatibility - Tested with macOS MPS

#63

by adeebaldkheel - opened Oct 31

base: refs/heads/main

←

from: refs/pr/63

Discussion Files changed

+13

-5

adeebaldkheel

Oct 31

Fix: Add Transformers 4.47+ compatibility

Wraps LlamaFlashAttention2 import in try-except for backward compatibility
Falls back to LlamaAttention when FlashAttention2 unavailable
Tested on Transformers 4.46.3 with macOS MPS

Fix: Add Transformers 4.47+ compatibility - Wraps LlamaFlashAttention2 import in try-except for backward compatibility - Falls back to LlamaAttention when FlashAttention2 unavailable - Tested on Transformers 4.46.3 with macOS MPS - Minimal change: 1 file, 13 insertions, 5 deletions932c5f63

adeebaldkheel changed pull request title from Fix: Add Transformers 4.47+ compatibility - Wraps LlamaFlashAttention2 import in try-except for backward compatibility - Falls back to LlamaAttention when FlashAttention2 unavailable - Tested on Transformers 4.46.3 with macOS MPS - Minimal change: 1 file, 13 insertions, 5 deletions to Fix: Add Transformers 4.47+ compatibility - Wraps LlamaFlashAttention2 import in try-except for backward compatibility - Tested on Transformers 4.46.3 with macOS MPS Oct 31

adeebaldkheel changed pull request title from Fix: Add Transformers 4.47+ compatibility - Wraps LlamaFlashAttention2 import in try-except for backward compatibility - Tested on Transformers 4.46.3 with macOS MPS to Fix: Add Transformers 4.47+ compatibility - Tested with macOS MPS Oct 31

adeebaldkheel changed pull request status to closed Nov 8

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment