GPT in parallel computing environments