Why do we need regularisation (L2 or L1 norm) in logistic regression?

As I was revising through my logistic regression notes and came around the loss minimization interpretation of logistic regression which is:

argmin(w) log(1 + exp(-Zi)) + 1/2lambda||w||^2 where Zi = Yi.Wi.Xi summation i : 1->n

I know that, the L2 regularisation as used in the above optimization function is used to find a balance between a good seperating hyperplane (decision surface) and weight coefficients that are not too large (tending to infinity) to be overestimated. I can't seem to intuitively understand as to how regularisation is working to balance the weight coefficients to avoid overfitting/underfitting? Also I might be having a misunderstanding here but in the loss function optimization part of the expression, if we consider that we are not using any regularisation, then ideally to minimise the loss function, For points that are correctly seperated, the weights corresponding to features should tend to infinity such the value of Zi tends to infinity which results in log(1 + exp(-Zi)) tending to 0 so we are minimizing the sum over correctly classified points but for the same plane with infinitely big weights, if a point comes out to be incorrectly classified it's loss function value will tend to infinity which makes it working against the optimisation problem. So accordingly the weights should get readjusted to smaller values, such that the sum of loss is minimized, without the need of a regularisation term. So I am really very confused as do we even need regularisation in logistic regression, if yes, how regularisation term in the expression is working towards balancing the weights?

đź‘Ť︎ 7
đź’¬︎
👤︎ u/MrDeepThought2
đź“…︎ Dec 01 2021
🚨︎ report
PICUM: Regularisation works. But it needs to be done well. Here are 7 elements to make regularisation schemes quick, humane and effective. mobile.twitter.com/PICUM_…
đź‘Ť︎ 3
đź’¬︎
👤︎ u/amondyyl
đź“…︎ Nov 08 2021
🚨︎ report
Buying out / regularisation of study periods

I just learned from mypension.be that years of study in university can be bought out to increase your Belgian statutory pension. Has anyone else made use of this? The numbers make it sound fairly profitable, although probably less so than simply investing the same amount of money now.

It costs €1560 per year of study, and this amount is tax deductible. So, €780ish after tax. For this, you receive €277 (single)/€347 (married/legally cohabiting) extra per year per once you retire.

Assuming you invest the same amount now at an average of 7% returns on a diverse ETF, it would grow to an average of €16655 over 35 years. Using the 4% withdrawal rule, this would allow you to then withdraw €666 per year. So, investing the same amount of money yourself is roughly twice as profitable on average, but also carries more risk given that market returns could be either high or lower.

Has anyone made use of this?

Secondary question, does anyone know if studies abroad (outside of Belgium but within EU) can likewise be bought out?

đź‘Ť︎ 8
đź’¬︎
👤︎ u/soupyshoes
đź“…︎ Aug 20 2021
🚨︎ report
Regression -- is there a way to use logit as a regulariser? For example, if the dependent variable is numeric, the regularisation is based on whether the predicted values are positive or negative.

Just to clarify some more, let's say we're trying to predict height/depth from sea level over different days/seasons (so time series). The value is negative if depth, positive if height.

Let's say we apply some regression model to predict it, but one of the priorities is to correctly predict the positive or negative sign before optimising for the distance of the height/depth.

What are some approaches to this problem? What would it be called?

Edit: I should mention that I'm considering the the time series data to be one data point per point of time.

đź‘Ť︎ 9
đź’¬︎
👤︎ u/jinnyjuice
đź“…︎ Jun 27 2021
🚨︎ report
Regularisation des charges locatives: droits et devoirs du locataire

Bonjour,

Je vous Ă©cris car je viens de recevoir la regularisation des charges locatives de 2019 de 83 euros et celle de 2020 de 564 euros par mon agence.

**voici mes informations**

* date d’entree: 27/08/2019

* adresse: Paris

* loyer: 781 euros

* provision sur charges: 20 euros

* immeuble sans ascenseur, sans gardien ni concierge construit avant 1949

Je tiens a commencer par le fait que je n’ai aucune experience en location. C’est mon premier logement. Le montant élevé de la regularisation, le cumule des deux, et la nature inattendue de cette dépense me prennent par surprise. Cependant, ce n’est pas pour autant que je ne veux pas payer. Je veux m’informer sur mes droits et devoirs et connaitre les options que j’ai. J’espère que vous pourrez m’aider. Si vous connaissez d’autres contacts où je peux demander des informations je suis preneur.

j’ai ajouté en pieces jointes, plus bas, les deux documents envoyés par mon agence.

**Concernant la regularisation des charges 2020:**

  1. il est écrit dans le “Récapitulatif des charges” que le lot concerné est l’appartement plus la cave. Je ne loue que l’appartement et non la cave. Puis-je demander un “Récapitulatif des charges” que pour l’appartement et qui ne tiennent pas compte des dépenses liées a la cave ?

  2. dans la consommation d’eau il est écrit que j’ai consommé 226 euros ( pour 3,45 euros le m3) ca me fait 65 m3 d’eau. La moyenne étant de 53 m3. Je ne pense pas consommer plus que le français moyen. Comment puis-je voir ma consommation d’eau pour comparer avec ce qui m’est facturé ?

  3. l’électricité compte-t-elle comme une dépense que je dois payer ? Je paye deja la consommation de mon logement

  4. la deuxième plus grande dépense est “Locations compteurs”, a quoi cela fait reference ? est ce que ça fait partie de la part locative ?

  5. la troisième dépense est le “salaire” sachant qu’il n’y a ni gardien ni concierge. A quoi cela fait référence ? Est ce que ça fait partie de la part locative ?

  6. puis-je demander les justificatifs de toutes ces dépenses ? Le bailleur est-il dans l’obligation de me les fournir ? Que puis-je faire s’il refuse de me les fournir ?

  7. puis-je demander le mode de répartition des charges ? Pour voir à combien monte la part des autres locataires de l’immeuble. Le bailleur est-il dans l’obligation de me les fournir ? Que puis-je faire s’il refuse ?

**Comparaison entre 2019 et 2020**

  1. pour l’année 2019 les charges récupérables se montent a 396.33
... keep reading on reddit ➡

đź‘Ť︎ 10
đź’¬︎
đź“…︎ Apr 09 2021
🚨︎ report
After almost two months, the hunger strike of the more than 400 undocumented migrants in Brussels in a bid to get collective regularisation will come to an end for the time being. brusselstimes.com/belgium…
đź‘Ť︎ 4
đź’¬︎
👤︎ u/Naurgul
đź“…︎ Jul 27 2021
🚨︎ report
[R] Overparameterization is the new regularisation trick of modern deep learning. I made a visualization of that unintuitive phenomenon:

my visualization, the arxiv paper from OpenAI

đź‘Ť︎ 113
đź’¬︎
👤︎ u/Giacobako
đź“…︎ Jun 19 2020
🚨︎ report
Plenty of these in regularisation
đź‘Ť︎ 66
đź’¬︎
👤︎ u/thomas_mckelvey
đź“…︎ Jan 26 2021
🚨︎ report
Dutch: regularisation of some irregular verbs

These last few years I've noticed that my sister tends to conjugate certain irregular verbs in Dutch as if they were regular. These include 'hangde' (hung) instead of 'hing' and 'loopte' (ran [BE], walked [NL]) instead of 'liep'. She is in her twenties, a native speaker from Belgium (West-Flanders) from a non-migrant background, and has a higher degree (nothing to do with linguistics though).

I find this particularly interesting because these are quite common verbs, but she told me that I was the only one who made comments on that. Could it be that we are witnessing a gradual regularisation of certain irregular verbs in Dutch? I would like to know your take on this and if you are noticing something similar in other languages.

đź‘Ť︎ 197
đź’¬︎
👤︎ u/Leiegast
đź“…︎ Apr 09 2020
🚨︎ report
Head Teachers have been protesting outside the Sindh Assembly for the past week on regularisation mobile.twitter.com/IBAhea…
đź‘Ť︎ 3
đź’¬︎
👤︎ u/Astonford
đź“…︎ Mar 20 2021
🚨︎ report
Migrant workers regularisation puts strain on Italy’s ruling coalition euractiv.com/section/agri…
đź‘Ť︎ 18
đź’¬︎
👤︎ u/Robi_damian
đź“…︎ May 12 2020
🚨︎ report

Please note that this site uses cookies to personalise content and adverts, to provide social media features, and to analyse web traffic. Click here for more information.