Counting permutations with no long monotone subsequence via generating trees and the kernel method

Mireille Bousquet-Mélou (1)

1 LaBRI - Laboratoire Bordelais de Recherche en Informatique

We recover Gessel's determinantal formula for the generating function of permutations with no ascending subsequence of length m+1. The starting point of our proof is the recursive construction of these permutations by insertion of the largest entry. This construction is of course extremely simple. The cost of this simplicity is that we need to take into account in the enumeration m-1 additional parameters --- namely, the positions of the leftmost increasing subsequences of length i, for i=2,...,m. This yields for the generating function a functional equation with m-1 ''catalytic'' variables, and the heart of the paper is the solution of this equation. We perform a similar task for involutions with no descending subsequence of length m+1, constructed recursively by adding a cycle containing the largest entry. We refine this result by keeping track of the number of fixed points. In passing, we prove that the ordinary generating functions of these families of permutations can be expressed as constant terms of rational series.

Mots clés: Permutations; Ascending subsequences; Generating functions; Generating trees

Domaines: Combinatoire [math.CO]

Mireille Bousquet-Mélou. Counting permutations with no long monotone subsequence via generating trees and the kernel method. Journal of Algebraic Combinatorics, 2011, 33 (4), pp.571--608. ⟨hal-00488409v3⟩