Some characterization results for permutation algebras