diff --git a/docs/user_guide/development.ipynb b/docs/user_guide/development.ipynb index ce29eac40..21ec044a3 100644 --- a/docs/user_guide/development.ipynb +++ b/docs/user_guide/development.ipynb @@ -7383,6 +7383,366 @@ "```" ] }, + { + "attachments": {}, + "cell_type": "markdown", + "id": "origin-varying-intro", + "metadata": {}, + "source": [ + "### Origin-varying patterns\n", + "\n", + "`DevelopmentML` predicts every cell of the `Triangle`, so its `ldf_` has one row per\n", + "origin period, where `Development` has a single row. Whether those rows differ\n", + "depends on the model. The over-dispersed Poisson (ODP) cross-classified GLM, fit to\n", + "incrementals with a log link and the design matrix `C(development) + C(origin)`,\n", + "gives the same pattern for every origin, and that pattern is the volume-weighted\n", + "chainladder {cite}`taylor2016`." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "id": "origin-varying-odp", + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
12-2424-3636-48
20013.49101.74701.4570
20023.49101.74701.4570
20033.49101.74701.4570
20043.49101.74701.4570
20053.49101.74701.4570
20063.49101.74701.4570
20073.49101.74701.4570
20083.49101.74701.4570
20093.49101.74701.4570
20103.49101.74701.4570
" + ], + "text/plain": [ + " 12-24 24-36 36-48\n", + "2001 3.491 1.747 1.457\n", + "2002 3.491 1.747 1.457\n", + "2003 3.491 1.747 1.457\n", + "2004 3.491 1.747 1.457\n", + "2005 3.491 1.747 1.457\n", + "2006 3.491 1.747 1.457\n", + "2007 3.491 1.747 1.457\n", + "2008 3.491 1.747 1.457\n", + "2009 3.491 1.747 1.457\n", + "2010 3.491 1.747 1.457" + ] + }, + "execution_count": null, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "genins = cl.load_sample(\"genins\")\n", + "\n", + "# alpha=0 turns off the default L2 penalty\n", + "cross_classified = cl.TweedieGLM(\n", + " design_matrix=\"C(development) + C(origin)\", alpha=0, max_iter=1000\n", + ").fit(genins)\n", + "cross_classified.ldf_.iloc[..., :3].round(3)" + ] + }, + { + "attachments": {}, + "cell_type": "markdown", + "id": "origin-varying-drift", + "metadata": {}, + "source": [ + "Every row matches `cl.Development().fit(genins).ldf_`. Adding an\n", + "`origin:I(development / 12)` term lets the development pattern drift from one origin\n", + "year to the next, so each origin gets its own age-to-age factors. Here the factors\n", + "rise for later origins." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "id": "origin-varying-fit", + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
12-2424-3636-48
20013.43201.72701.4430
20023.44601.73301.4480
20033.46001.73801.4520
20043.47401.74301.4570
20053.48801.74901.4610
20063.50201.75401.4660
20073.51601.76001.4710
20083.53101.76601.4750
20093.54501.77101.4800
20103.56001.77701.4850
" + ], + "text/plain": [ + " 12-24 24-36 36-48\n", + "2001 3.432 1.727 1.443\n", + "2002 3.446 1.733 1.448\n", + "2003 3.460 1.738 1.452\n", + "2004 3.474 1.743 1.457\n", + "2005 3.488 1.749 1.461\n", + "2006 3.502 1.754 1.466\n", + "2007 3.516 1.760 1.471\n", + "2008 3.531 1.766 1.475\n", + "2009 3.545 1.771 1.480\n", + "2010 3.560 1.777 1.485" + ] + }, + "execution_count": null, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "drifting = cl.TweedieGLM(\n", + " design_matrix=\"C(development) + C(origin) + origin:I(development / 12)\",\n", + " alpha=0,\n", + " max_iter=1000,\n", + ").fit(genins)\n", + "drifting.ldf_.iloc[..., :3].round(3)" + ] + }, + { + "attachments": {}, + "cell_type": "markdown", + "id": "origin-varying-methods", + "metadata": {}, + "source": [ + "`Chainladder` applies each origin's own row of `ldf_`: an\n", + "origin's ultimate is its latest diagonal times the product of its own factors from\n", + "its current age onward. Dividing by the traditional chainladder ultimates shows the\n", + "drift raising the recent origins most." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "id": "origin-varying-ultimates", + "metadata": {}, + "outputs": [ + { + "data": { + "text/html": [ + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
2261
20011.0000
20021.0010
20031.0040
20041.0090
20051.0180
20061.0290
20071.0430
20081.0660
20091.0950
20101.1350
" + ], + "text/plain": [ + " 2261\n", + "2001 1.000\n", + "2002 1.001\n", + "2003 1.004\n", + "2004 1.009\n", + "2005 1.018\n", + "2006 1.029\n", + "2007 1.043\n", + "2008 1.066\n", + "2009 1.095\n", + "2010 1.135" + ] + }, + "execution_count": null, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "plain = cl.Chainladder().fit(cl.Development().fit_transform(genins))\n", + "drift = cl.Chainladder().fit(drifting.transform(genins))\n", + "(drift.ultimate_ / plain.ultimate_).round(3)" + ] + }, + { + "attachments": {}, + "cell_type": "markdown", + "id": "origin-varying-note", + "metadata": {}, + "source": [ + "```{note}\n", + "The `origin:I(development / 12)` term illustrates one kind of time-heterogeneity. Test\n", + "any such term against the data, for example with residuals by origin, before relying\n", + "on it. `TweedieGLM` applies an L2 penalty by default, so this example sets `alpha=0` to fit\n", + "the unpenalized GLM.\n", + "```" + ] + }, { "attachments": {}, "cell_type": "markdown",