<div id="wtr-content" 
	 	data-bg="#FFFFFF" 
	 	data-fg="#dd9933" 
	 	data-width="6" 
	 	data-mute="1" 
	 	data-fgopacity="1.00" 
	 	data-mutedopacity="1.00" 
	 	data-placement="bottom" 
	 	data-placement-offset="0" 
	 	data-content-offset="0" 
	 	data-placement-touch="bottom" 
		 data-placement-offset-touch="0" 
	 	data-transparent="1" 
	 	data-shadow="0" 
	 	data-touch="1" 
	 	data-non-touch="0" 
	 	data-comments="0" 
	 	data-commentsbg="#ffcece" 
	 	data-location="page" 
	 	data-mutedfg="#dd9933" 
	 	data-endfg="transparent" 
	 	data-rtl="1" 
	 	>
<p>Ø§Ø®ØªÙØ§Ø±Ù <a href="https://elakademiapost.com/%D9%83%D9%8A%D9%81-%D9%8A%D8%AA%D9%85-%D8%A7%D8%AE%D8%AA%D9%8A%D8%A7%D8%B1-%D8%A7%D9%84%D8%AE%D9%88%D8%A7%D8%B1%D8%B2%D9%85%D9%8A%D8%A7%D8%AA-%D8%A7%D9%84%D8%AA%D8%AD%D8%B3%D9%8A%D9%86%D9%8A%D8%A9/" target="_blank" rel="noreferrer noopener">ÙÙØ®ÙØ§Ø±Ø²Ù ÙØ© Ø§ÙØªØØ³ÙÙÙØ©</a> اÙÙ ÙØ§Ø³Ø¨Ø© ÙØªØ¯Ø±Ùب ÙÙ ÙØ°Ø¬Ù ÙÙØªØ¹ÙÙ Ø§ÙØ¹Ù ÙÙØ ÙØ¹Ù٠٠باشرة Ø§Ø®ØªÙØ§Ø±Ù Ø¬ÙØ¯Ø© Ù٠دة Ø§ÙØªÙÙÙØ°. ÙØ§Ø®ØªÙØ§Ø±Ù ÙØ°Ø§ Ù٠اÙÙÙÙ Ø© اÙÙØµÙ ÙÙ ÙØ¯Ø±ØªÙ عÙÙ Ø§ÙØØµÙ٠عÙÙ ÙØªØ§Ø¦Ø¬ ÙÙ Ø¯ÙØ§Ø¦ÙØ Ø£Ù Ø³Ø§Ø¹Ø§ØªØ Ø£Ù ØØªÙ Ø£ÙØ§Ù . أ٠رب٠ا Ø¹Ø¯Ù ØØµÙÙ٠عÙÙ ÙØªÙجة Ø®ÙØ§Ù ÙØªØ±Ø© ØÙاتÙ. Ù٠٠بÙÙ ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ§ØªØ ÙØ¬Ø¯ Ø£Ù Ø®ÙØ§Ø±Ø²Ù ÙØ© أد٠ADAM ÙÙ Ø£ØØ¯ Ø£ÙØ«Ø± Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ§Øª Ø§ÙØªØØ³ÙÙÙØ© Ø§Ø³ØªØ®Ø¯Ø§Ù ÙØ§ ÙÙ Ù Ø¬Ø§Ù Ø§ÙØªØ¹ÙÙ Ø§ÙØ¹Ù ÙÙ. ÙØªØØ¯ÙØ¯ÙØ§ ÙÙ ØªØ¯Ø±ÙØ¨ Ø§ÙØ´Ø¨Ùات Ø§ÙØ¹ØµØ¨ÙØ© Ø§ÙØ§ØµØ·ÙØ§Ø¹ÙØ©. ÙÙØ¯ Ø£Ø´Ø±ÙØ§ Ø³Ø§Ø¨ÙØ§ Ø£Ù <a href="https://elakademiapost.com/%D8%AA%D8%B9%D8%B1%D9%81-%D8%B9%D9%84%D9%89-%D8%AE%D9%88%D8%A7%D8%B1%D8%B2%D9%85%D9%8A%D8%A9-%D8%A7%D9%84%D9%86%D8%B2%D9%88%D9%84-%D8%A7%D9%84%D8%AA%D8%AF%D8%B1%D8%AC%D9%8A-%D8%A7%D9%84%D8%A3%D8%B4/" target="_blank" rel="noreferrer noopener">Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ù٠تØÙØ±Ø§ØªÙØ§</a> ÙÙ Ø§ÙØ£Ùثر Ø§Ø³ØªØ®Ø¯Ø§Ù ÙØ§ ÙÙ ÙØ°Ø§ اÙÙ Ø¬Ø§ÙØ ÙÙ٠٠ا ÙÙ ÙØ°Ùر٠ÙÙ Ø£Ù Ø®ÙØ§Ø±Ø²Ù ÙØ© أد٠ADAM Ù٠٠تØÙر ٠٠٠تØÙرات Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù. ÙØ¨Ø§ÙØªØØ¯Ùد Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØªØµØ§Ø¯ÙÙØ© Stochastic Gradient descent.<br><br>ÙÙØ¯ استخد٠ت Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØªØµØ§Ø¯ÙÙØ© SGD ÙÙ Ø§ÙØ³ÙÙØ§Øª Ø§ÙØ£Ø®Ùرة بشÙÙ Ù ÙØ«Ù ÙÙØ¨Ùر ÙÙ ÙØ±Ùع Ø¹Ø¯ÙØ¯Ø© Ù Ù Ø§ÙØ°Ùاء Ø§ÙØ§ØµØ·ÙØ§Ø¹ÙØ ÙØ¹Ù Ø£Ø¨Ø±Ø²ÙØ§ Ù٠ا Ø§ÙØ±Ø¤ÙØ© Ø§ÙØØ§Ø³ÙØ¨ÙØ© computer visionØ ÙÙ Ø¹Ø§ÙØ¬Ø© اÙÙØºØ© Ø§ÙØ·Ø¨ÙØ¹ÙØ© Natural Language Processing.</p>



<h2 class="wp-block-heading">٠ا ÙÙ Ø®ÙØ§Ø±Ø²Ù ÙØ© أد٠ADAMØ</h2>



<h3 class="wp-block-heading">أصÙÙ Ø®ÙØ§Ø±Ø²Ù ÙØ© أد٠ADAM</h3>



<p>ابتÙÙØ±Øª Ø®ÙØ§Ø±Ø²Ù ÙØ© Ø£Ø¯Ù Ø¨ÙØ¯Ù Ø§Ø³ØªØ¨Ø¯Ø§Ù Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØªØµØ§Ø¯ÙÙØ©Ø ÙØ°ÙÙØ ØªØØ¯Ùدا٠Ù٠ع٠ÙÙØ© ØªØ¯Ø±ÙØ¨ Ù٠اذج Ø§ÙØªØ¹ÙÙ Ø§ÙØ¹Ù ÙÙ deep learning. ÙÙØ¯ ØªÙ Ø§ÙØªØ±Ø§Ø ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ© Ù Ù Ø·Ø±Ù Ø¯Ø§ÙØ¯ÙرÙÙ ÙÙÙØºÙ ا Diederik Kingma رائدة اÙ٠جا٠<a href="https://en.wikipedia.org/wiki/OpenAI" target="_blank" rel="noreferrer noopener">OpenAI </a>٠جÙ٠٠با Jimmy Ba ٠٠جا٠عة ØªÙØ±ÙÙØªÙ Ø³ÙØ© 2015 ÙÙ ÙØ±ÙØ© Ø¨ØØ«ÙØ© Ù٠٠ؤت٠ر <a href="https://iclr.cc/About" target="_blank" rel="noreferrer noopener">ICLR </a>باس٠&#8220;أد٠: طرÙÙØ© ÙÙØªØØ³ÙÙ Ø§ÙØªØµØ§Ø¯ÙÙ&#8221;Ø Adam: a method for stochastic optimization. ØªÙ ØªØ³Ù ÙØ© ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ© Ø£Ø¯Ù Ø§Ø®ØªØµØ§Ø±ÙØ§ Ù: <strong>ADA</strong>ptive <strong>M</strong>oment estimation <;=>; <strong>ADAM</strong>.</p>



<h3 class="wp-block-heading">Ù Ù ÙØ²Ø§Øª Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ©</h3>



<p>ÙÙ ØªÙØ¯ÙÙ ÙÙ ÙØ®ÙØ§Ø±Ø²Ù ÙØ© Ø£Ø¯Ù Ø ÙØ¶Ø Ø§ÙØ¨Ø§ØØ«Ø§Ù Ù Ù ÙØ²Ø§Øª ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ© ÙÙ Ø§ÙØªØ¹Ø§Ù ٠٠ع اÙ٠شاÙÙ ØºÙØ± اÙÙ ØØ¯Ø¨Ø©Ø Ø£Ù Ø¯Ø§ÙØªÙا اÙÙØ¯Ù ØºÙØ± Ù ØØ¯Ø¨Ø© non-convex objective function. ٠٠بÙÙÙØ§:</p>



<ul class="wp-block-list"><li>سÙÙÙØ© تÙÙÙØ° Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ©.</li><li>ÙÙØ¤Ø© ØÙسبÙÙØ§ computationally efficient.</li><li>استÙÙØ§Ù ضعÙÙ ÙÙØ°Ø§Ùرة.</li><li>ØºÙØ± ØØ³Ø§Ø³Ø© <a href="https://stats.stackexchange.com/questions/360322/what-does-diagonal-rescaling-of-the-gradients-mean-in-adam-paper" target="_blank" rel="noreferrer noopener">ÙØ¥Ø¹Ø§Ø¯Ø© اÙÙÙØ§Ø³ اÙÙØ·Ø±Ù ÙÙØªØ¯Ø±Ø¬Ø§Øª</a>. أ٠أÙÙØ§ ØºÙØ± ØØ³Ø§Ø³Ø© ÙØ¶Ø±Ø¨ Ù ØªØ¬ÙØ© Ø§ÙØªØ¯Ø±Ø¬ Ù٠٠صÙÙÙØ© ÙØ·Ø±ÙØ© Ù ÙØ¬Ø¨Ø© Ø§ÙØ¹Ùا٠Ù. ÙÙÙÙÙØ§ تستع٠٠اÙÙ Ø´ØªÙØ§Øª Ø§ÙØ¬Ø²Ø¦ÙØ©Ø Ø¨Ø¯ÙÙØ§ Ù Ù Ø§ÙØªØ¯Ø±Ø¬ Ø§ÙØ°Ù تستع٠ÙÙ Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØªØµØ§Ø¯ÙÙØ©.</li><li>Ù ÙØ³Ø§Ø¨Ø© Ø¹ÙØ¯ تعدد اÙÙ ØªØºÙØ±Ø§Øª ÙÙØ¨Ø± عÙÙØ§Øª Ø§ÙØ¨ÙØ§ÙØ§Øª.</li><li>Ø¬ÙØ¯Ø© ٠ع اÙ٠شاÙÙ ØºÙØ± Ø§ÙØ«Ø§Ø¨ØªØ©Ø Ø£Ù ÙØ¶Ø§Ø¡ Ø§ÙØ¨ØØ« Ù ØªØºÙØ± Ø¨Ø¯ÙØ§ÙØ© Ø§ÙØ²Ù Ù.</li><li>ÙØ¹Ø§ÙØ© Ø¹ÙØ¯ ÙØ¬Ùد تشÙÙØ´ ÙØ¤Ø«Ø± عÙÙ ÙÙÙ Ø§ÙØªØ¯Ø±Ø¬.</li><li>اÙÙ ØªØºÙØ±Ø§Øª Ø§ÙØ£Ø³Ø§Ø³ÙØ© ÙÙ Ø§ÙØªØÙÙ ÙÙ Ø§ÙØªÙÙÙØ°Ø أ٠اÙ٠عÙ٠ات اÙÙØ§Ø¦ÙØ© hyperparametersØ Ø¨Ø¯ÙÙÙØ© ÙÙØ§ ØªØØªØ§Ø¬ ضبط Ù Ø¹ÙØ¯. ÙØ¶Ø¨Ø· ÙØ°Ù Ø§ÙØ£Ø®Ùرة parameter tuning ÙØ¹Ø¯ Ù Ø´ÙÙØ©Ù ØªØØ³ÙÙÙØ©Ù ÙÙ Ø§ÙØ£Ø®Ø±Ø ÙÙØ³ØªØ¹Ù Ù Ø®ÙØ§Ø±Ø²Ù ÙØ§Øª ØªØØ³ÙÙÙØ© ÙØ¶Ø¨Ø·Ùا Ø¹ÙØ¯ Ø§ÙØØ§Ø¬Ø©.</li></ul>



<h2 class="wp-block-heading">Ø¢ÙÙØ© ع٠٠أد٠</h2>



<p>تختÙÙ Ø£Ø¯Ù Ø¹Ù Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØªØµØ§Ø¯ÙÙØ©. ÙÙÙÙÙØ§ تأخذ ٠عد٠تعÙÙ Ø¨Ø§Ø±Ø§Ù ØªØ±ÙØ أ٠٠عد٠تعÙÙ ÙØªØºÙر Ø¨Ø¯ÙØ§ÙØ© Ù ØªØºÙØ±Ø§Øª ٠عÙÙØ©. Ù Ø¹Ø¯Ù Ø§ÙØªØ¹ÙÙ ÙØ°Ø§ ÙÙ ØØ¬Ù Ø§ÙØ®Ø·ÙØ© Ø¹ÙØ¯ ÙÙ Ø¯ÙØ±Ø© ØªÙØ±Ø§Ø± تÙÙÙØµ ÙÙØ¯Ø§ÙØ© اÙÙØ¯Ù. راجع(Ù) اÙÙ ÙØ§Ù Ø§ÙØ³Ø§Ø¨Ù ÙØªÙØ¶ÙØ Ø£ÙØ¨Ø±: <a href="https://elakademiapost.com/%D8%AA%D8%B9%D8%B1%D9%81-%D8%B9%D9%84%D9%89-%D8%AE%D9%88%D8%A7%D8%B1%D8%B2%D9%85%D9%8A%D8%A9-%D8%A7%D9%84%D9%86%D8%B2%D9%88%D9%84-%D8%A7%D9%84%D8%AA%D8%AF%D8%B1%D8%AC%D9%8A-%D8%A7%D9%84%D8%A3%D8%B4/" target="_blank" rel="noreferrer noopener">تعر٠عÙÙ Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØ£Ø´Ùر ÙÙ Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ§Øª Ø§ÙØªØØ³ÙÙÙØ©</a>.<br><br>ÙØªÙ ØªØØ¯Ùد Ù Ø¹Ø¯Ù Ø§ÙØªØ¹ÙÙ Ø Ø£Ù ØØ¬Ù Ø§ÙØ®Ø·ÙØ© ÙØ°Ø§Ø Ø§ÙØ·ÙØ§ÙØ§ Ù Ù ØªÙØ¯Ùرات Ø§ÙØ¹Ø²Ù Ø§ÙØ£ÙÙ ÙØ§ÙثاÙÙ ÙÙØªØ¯Ø±Ø¬. ÙÙØµÙ Ø§ÙØ¨Ø§ØØ«Ø§Ù ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ© بÙÙÙÙØ§ Ø¯Ù Ø¬ÙØ§ بÙÙ Ø¥Ø«ÙØªÙÙ Ù Ù Ø³Ø§Ø¨ÙØªÙÙØ§Ø ÙØ§ÙÙØªØ§Ù Ø¨Ø¯ÙØ±Ù٠ا ٠٠٠تØÙرات Ø®ÙØ§Ø±Ø²Ù ÙØ© اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù Ø§ÙØªØµØ§Ø¯ÙÙØ© ÙÙ٠ا:</p>



<h3 class="wp-block-heading">Ø®ÙØ§Ø±Ø²Ù ÙØ© Ø§ÙØªØ¯Ø±Ø¬ اÙ٠تأÙÙÙ </h3>



<p><strong>Ada</strong>ptive <strong>Grad</strong>ient AlgorithmØ Ø£Ù <strong>AdaGrad</strong>: ÙØ§Ùت٠ÙÙ Ø§ÙØ£Ø®Ø±Ù ØªØ³ØªØ¹Ù Ù ØØ¬Ù Ø®Ø·ÙØ© Ù ØªØºÙØ± ÙØªØ¹Ø²Ùز Ø£Ø¯Ø§Ø¦ÙØ§ ÙÙ ØÙ اÙ٠شاÙ٠ذات Ø§ÙØªØ¯Ø±Ø¬ Ø§ÙØ¶Ø¦ÙÙ. ٠ا ÙØ¹ÙÙ ÙÙ Ø§ÙØªØ¹ÙÙ Ø§ÙØ¹Ù ÙÙ Ø£Ù Ø§ÙØ´Ø¨ÙØ© ÙØ§ ØªØ³ØªÙØ¨Ù إشارات ÙØ§ÙÙØ© ÙØ¶Ø¨Ø· Ø£ÙØ²Ø§ÙÙØ§. ÙÙ Ù Ø£Ù Ø«ÙØ© ÙØ°Ù اÙ٠شاÙÙ ÙØ¬Ø¯: Ù Ø¹Ø§ÙØ¬Ø© اÙÙØºØ© Ø§ÙØ·Ø¨ÙØ¹ÙØ© NLPØ Ù Ø§ÙØ±Ø¤ÙØ© Ø§ÙØØ§Ø³ÙØ¨ÙØ©Ø ÙØºÙØ±ÙØ§.</p>



<h3 class="wp-block-heading">Ø®ÙØ§Ø±Ø²Ù ÙØ© Ø§ÙØªØ´Ø§Ø± جذر Ù ØªÙØ³Ø· اÙ٠ربع</h3>



<p><strong>R</strong>oot <strong>M</strong>ean <strong>S</strong>quare <strong>Propa</strong>gationØ Ø£Ù <strong>RMSPropa</strong>: Ø§ÙØªÙ Ø£ÙØ¶Ùا ØªØ³ØªØ¹Ù Ù Ø®Ø·ÙØ© Ù ØªØºÙØ±Ø©. ذÙÙ Ø§ÙØªØºÙØ±Ø Ø¨Ø¯ÙØ§ÙØ© Ù ØªÙØ³Ø· Ù ÙØ¶Ù ØÙ ÙÙØªØ¯Ø±Ø¬Ø§Øª Ø§ÙØ¬Ø²Ø¦ÙØ©. ٠ا ÙØ¹Ù٠أ٠أداء ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ© Ø¬ÙØ¯ Ø¹ÙØ¯ Ù ÙØ§Ø¬ÙØªÙØ§ Ù٠شاÙ٠ذات ÙØ¶Ø§Ø¡ Ø¨ØØ« Ù ØªØºÙØ± ز٠ÙÙÙØ§Ø Ø£Ù Ø¹ÙØ¯ ÙØ¬Ùد تشÙÙØ´ ÙØºÙر Ù Ù ÙÙÙ Ø§ÙØªØ¯Ø±Ø¬.</p>



<h3 class="wp-block-heading">ÙÙ٠تج٠ع أد٠ADAM ÙÙØ§Ø¦Ø¯ ÙØ§ØªÙÙ Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØªÙÙØ</h3>



<p>ÙØ¨Ø¯Ùا٠٠٠تÙÙÙÙ Ù Ø¹Ø¯ÙØ§Øª Ø§ÙØªØ¹ÙÙ ÙÙ ØªØºÙØ±Ø§Øª Ø§ÙØ¯Ø§ÙØ© اÙÙØ¯Ù Ø¨ÙØ§Ø¡Ù عÙÙ Ù ØªÙØ³Ø· <a href="https://ar.wikipedia.org/wiki/%D8%B9%D8%B2%D9%85_(%D8%B1%D9%8A%D8%A7%D8%B6%D9%8A%D8%A7%D8%AA)" target="_blank" rel="noreferrer noopener">​​Ø§ÙØ¹Ø²Ù </a> Ø§ÙØ£ÙÙ average first moment Ù٠ا ÙÙ Ø§ÙØØ§Ù ÙÙ RMSPropØ ØªØ³ØªØ®Ø¯Ù Ø¢Ø¯Ù Ø£ÙØ¶Ø§ Ù ØªÙØ³Ø· ​​Ø§ÙØ¹Ø²ÙÙ Ø§ÙØ«Ø§ÙÙØ© ÙÙØªØ¯Ø±Ø¬Ø§Øª Uncentered variance.<br><br>ÙØ¨Ø§Ø³ØªØ¹Ù Ø§Ù Ø§ÙØ¹Ø²Ù ÙØ¥ÙÙØ§ ÙØªÙ ÙÙ Ù Ù Ø§ÙØªØÙÙ ÙÙ Ù ÙØ¯Ø§Ø± اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù بطرÙÙØ© تÙÙÙ ÙÙÙØ§ Ø§ÙØªØ°Ø¨Ø°Ø¨Ø§Øª Ø¹ÙØ¯ أدÙÙ ÙÙÙ ÙØ§ Ø¹ÙØ¯ Ø§ÙØªØ±Ø§Ø¨Ùا ÙÙØÙ Ø§ÙØ£Ù Ø«ÙØ أ٠تÙÙØµ ØØ¬Ù Ø§ÙØ®Ø·Ùات ÙÙ٠ا أصبØÙا Ø£ÙØ±Ø¨ ÙÙØÙ Ø§ÙØ£Ù Ø«Ù. بÙÙ٠ا ÙÙÙÙ ØØ¬Ù Ø§ÙØ®Ø·ÙØ© Ù Ø¹ØªØ¨Ø±ÙØ§ Ø¹ÙØ¯ Ø§ÙØªØ±Ø§Ø¨Ùا ÙØÙ Ù ØÙÙ.</p>



<h2 class="wp-block-heading">Ø±ÙØ§Ø¶Ùات</h2>



<h3 class="wp-block-heading">Ø§ÙØ¹Ø²Ù </h3>



<p>ÙØ³ØªØ¹Ù Ù Ø§ÙØ¹Ø²Ù ÙØªØ³Ø±Ùع اÙÙØ²ÙÙ Ø§ÙØªØ¯Ø±Ø¬Ù.</p>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-202453.png" alt="" class="wp-image-53405"/><figcaption>تعبر (t)W ع٠ÙÙÙ Ø© Ø§ÙØ£Ùزا٠ÙÙ ÙØØ¸Ø© t. Ù٠ث٠أÙÙØ§ درجة Ø§ÙØªØ¹ÙÙ Ø Ø£Ù ØØ¬Ù Ø§ÙØ®Ø·ÙØ© Ø§ÙØØ§ÙÙ. Ù٠ا ت٠ث٠(t)m Ù Ø¬Ù ÙØ¹ Ø§ÙØªØ¯Ø±Ø¬Ø§Øª Ø¹ÙØ¯ اÙÙØØ¸Ø© t.</figcaption></figure>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-202526.png" alt="" class="wp-image-53406"/><figcaption>ت٠ث٠(t)m Ù Ø¬Ù ÙØ¹ Ø§ÙØªØ¯Ø±Ø¬Ø§Øª Ø¹ÙØ¯ اÙÙØØ¸Ø© t Ø£Ù Ø§ÙØ¯Ùرة Ø§ÙØØ§ÙÙØ©Ø بÙÙ٠ا (t-1)m تعبر Ø¹Ù ÙØ°Ø§ اÙÙ Ø¬Ù ÙØ¹ ÙÙ Ø§ÙØ¯Ùرة Ø§ÙØ³Ø§Ø¨ÙØ©. dL ÙÙ Ù Ø´ØªÙØ© Ø§ÙØ¯Ø§ÙØ© اÙÙØ¯ÙØ (t)dW Ù Ø´ØªÙØ© Ø§ÙØ£ÙØ²Ø§Ù Ø¹ÙØ¯ اÙÙØØ¸Ø© t. Ø¨ÙØªØ§ Ù٠اÙÙ ØªØºÙØ± اÙÙ ØªØØ±Ù (Ù ÙÙÙÙ Ø¥ØØµØ§Ø¦Ù).</figcaption></figure>



<h3 class="wp-block-heading">Ø§ÙØªØ´Ø§Ø± جدر Ù ØªÙØ³Ø· اÙ٠ربع RMSProp</h3>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-202858.png" alt="" class="wp-image-53407"/><figcaption>ØªÙ Ø«Ù ε Ø«Ø§Ø¨ØªØ© ØµØºÙØ±Ø© ÙØªØ¬Ùب اÙÙØ³Ù Ø© عÙÙ ØµÙØ±.</figcaption></figure>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-202921.png" alt="" class="wp-image-53408"/></figure>



<h3 class="wp-block-heading">أد٠</h3>



<p>Ø§ÙØ·ÙØ§ÙØ§ Ù Ù Ù Ø¹Ø§Ø¯ÙØ§Øª Ø§ÙØ·Ø±ÙÙØªÙÙ Ø£Ø¹ÙØ§ÙØ ÙØªØØµÙ عÙÙ:</p>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-203313.png" alt="" class="wp-image-53409"/><figcaption>Ù ØªØ¬ÙØ© Ø§ÙØ¹Ø²Ù Ø§ÙØ£ÙÙÙ (t)m. Ù ØªØ¬ÙØ© Ø§ÙØ¹Ø²Ù Ø§ÙØ«Ø§ÙÙØ© (t)v.</figcaption></figure>



<p>ÙØ¸Ø±Ùا ÙØ£Ù ÙÙ Ù Ù mt Ù vt ÙØ¯ ت٠تصÙÙØ±Ù٠ا بدئÙÙØ§Ø ÙÙØ°ÙÙ ÙÙÙÙ β1 Ù β2 تأخد ÙÙÙ ØªÙØ§Ø±Ø¨ 1Ø ÙÙØØ¸ ØªØ¬Ø±ÙØ¨ÙÙØ§ Ø£ÙÙ٠ا ÙÙØªØ³Ø¨Ø§Ù تØÙØ²ÙØ§ ÙØÙ Ø§ÙØµÙر. ÙØ¥ØµÙØ§Ø ÙØ°Ø§ ÙÙÙÙ Ø¨ØØ³Ø§Ø¨ ÙÙ٠تصØÙØÙØ©. ÙÙØªÙ ØØ³Ø§Ø¨ ÙØ°Ù اÙÙÙÙ Ø£ÙØ¶Ùا ÙÙØªØÙÙ ÙÙ Ø§ÙØ£ÙØ²Ø§Ù Ø¹ÙØ¯ ÙØ±Ø¨ ÙØµÙÙÙØ§ ÙÙØÙ Ø§ÙØ£Ù Ø«Ù ÙØ°ÙÙ ÙÙ ÙØ¹ Ø§ÙØªØ°Ø¨Ø°Ø¨Ø§Øª عاÙÙØ© Ø§ÙØªØ±Ø¯Ø¯. ÙØ§ÙØµÙØº اÙ٠ستخد٠ة ÙÙ:</p>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-203418.png" alt="" class="wp-image-53410"/></figure>



<p>٠ا ÙÙ ÙÙÙØ§ ٠٠استبدا٠mt Ù vt بÙÙÙ Ù ØµØØØ©:</p>



<figure class="wp-block-image size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Screenshot-2022-08-01-203552.png" alt="" class="wp-image-53411"/><figcaption>ÙØ¬Ø¯ (t)w ÙÙ٠اÙÙÙØ·Ø© Ø§ÙØØ§ÙÙØ© Ø¹ÙØ¯ اÙÙØØ¸Ø© t.</figcaption></figure>



<h2 class="wp-block-heading">Ø§ÙØ£Ø¯Ø§Ø¡ Ø§ÙØ¹Ù ÙÙ</h2>



<p>ÙÙÙÙÙØ§ ٠بÙÙØ© عÙÙ ÙÙØ§Ø· ÙÙØ© Ø³Ø§Ø¨ÙØ§ØªÙØ§Ø ÙØ¥Ù Ø®ÙØ§Ø±Ø²Ù ÙØ© أد٠ADAM ÙÙ Ø£ØØ¯ Ø£ÙØ¶Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ§Øª Ø§ÙØªØØ³ÙÙÙØ© عÙÙ Ø§ÙØ¥Ø·ÙØ§ÙØ ÙØ°Ù٠إ٠Ù٠تÙÙ Ø£ØµÙØ§ Ø£ÙØ¶ÙÙØ§. ÙÙØ¬Ø¯ Ø£Ù ÙØ°Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ© ØªÙØ¯Ù أداء أعÙÙ Ø¨ÙØ§Ù Ø´ ÙØ¨Ùر ٠٠أداء ÙØ¸ÙØ±Ø§ØªÙØ§Ø بØÙØ« تتÙÙ٠عÙÙÙÙ ÙØ§ Ù Ù ØÙØ« ÙÙÙØ© ØªØ¯Ø±ÙØ¨ اÙÙ٠اذج ÙÙØ· ب٠ÙÙ Ù ØÙØ« Ø§ÙØ£Ø¯Ø§Ø¡ Ø§ÙØ³Ø±Ùع ÙØ§ÙعاÙÙ.</p>


<div class="wp-block-image">
<figure class="aligncenter size-full"><img src="https://elakademiapost.com/wp-content/uploads/2022/08/Adam_training.png" alt="" class="wp-image-53413"/><figcaption>ÙØ¨Ù٠اÙÙ ÙØÙ٠أداء Ù Ø¬Ù ÙØ¹Ø© Ù Ù Ø§ÙØ®ÙØ§Ø±Ø²Ù ÙØ§Øª باÙÙ ÙØ§Ø±ÙØ© ٠ع أداء Ø®ÙØ§Ø±Ø²Ù ÙØ© أد٠ÙÙ Ø§ÙØªØ¯Ø±Ùب Ø§ÙØªØØ³ÙÙÙ ÙØ´Ø¨ÙØ© Ø¹ØµØ¨ÙØ© ٠تعددة Ø§ÙØ·Ø¨Ùات عÙÙ ØµÙØ± MNIST. اÙ٠صدر غÙÙØºÙ.</figcaption></figure></div>


<h2 class="wp-block-heading">٠صادر</h2>



<ol class="wp-block-list"><li><a href="https://machinelearningmastery.com/adam-optimization-algorithm-for-deep-learning/" target="_blank" rel="noreferrer noopener">MachineLearningMastery</a></li><li><a href="https://www.geeksforgeeks.org/intuition-of-adam-optimizer/" target="_blank" rel="noreferrer noopener">GeeksforGeeks</a></li><li><a href="https://optimization.cbe.cornell.edu/index.php?title=Adam" target="_blank" rel="noreferrer noopener">Cornell</a></li></ol>
<div class="uwp_widgets uwp_widget_author_box bsui sdel-9a8e25eb" ><div class="d-block text-center text-md-start d-md-flex p-3 bg-light ">
				<a href="https://elakademiapost.com/profile/bahibrahim/"><img src="https://elakademiapost.com/wp-content/uploads/2022/06/1-2_uwp_avatar_thumb.jpg" class="rounded-circle shadow border border-white border-width-4 me-3" width="60" height="60" alt="bahi brahim"></a>
				<div class="media-body">
					<h5 class="mt-0">Author: <a href="https://elakademiapost.com/profile/bahibrahim/">bahi brahim</a></h5>
					
					<p></p>
				</div>
			</div></div></div><div style='text-align:center' class='yasr-auto-insert-visitor'><!--Yasr Visitor Votes Shortcode--><div id='yasr_visitor_votes_58f29225b6bbe' class='yasr-visitor-votes'><div class="yasr-custom-text-vv-before yasr-custom-text-vv-before-53403">اضغط ÙÙØ§ ÙØªÙÙÙÙ Ø§ÙØªÙØ±ÙØ±</div><div id='yasr-vv-second-row-container-58f29225b6bbe' 
 class='yasr-vv-second-row-container'><div id='yasr-visitor-votes-rater-58f29225b6bbe' 
 class='yasr-rater-stars-vv' 
 data-rater-postid='53403' 
 data-rating='0' 
 data-rater-starsize='32' 
 data-rater-readonly='false' 
 data-rater-nonce='79bfbbed13' 
 data-issingular='true' 
 ></div><div class="yasr-vv-stats-text-container" id="yasr-vv-stats-text-container-58f29225b6bbe"><svg xmlns="https://www.w3.org/2000/svg" width="20" height="20" 
 class="yasr-dashicons-visitor-stats" 
 data-postid="53403" 
 id="yasr-stats-dashicon-58f29225b6bbe"> 
 <path d="M18 18v-16h-4v16h4zM12 18v-11h-4v11h4zM6 18v-8h-4v8h4z"></path> 
 </svg><span id="yasr-vv-text-container-58f29225b6bbe" class="yasr-vv-text-container">[Average: <span id="yasr-vv-average-container-58f29225b6bbe">0</span>]</span></div><div id='yasr-vv-loader-58f29225b6bbe' class='yasr-vv-container-loader'></div></div><div id='yasr-vv-bottom-container-58f29225b6bbe' class='yasr-vv-bottom-container'></div></div><!--End Yasr Visitor Votes Shortcode--></div>
بعد شهور من الترقب والحماس، أطلقت شركة "أوبن إيه آي" (OpenAI) نموذجها اللغوي الأحدث "جي…
في عالمٍ تتباين فيه الأقدار حدّ التناقض، حيث تُزيَّن موائد البعض بأشهى الأطعمة وتُلتقط صورها…
"تصميم الحياة " ثورة في عالم البيولوجيا التخليقية في خطوة جريئة وغير مسبوقة، أعلن تحالف…
لطالما كان حلم محاكاة العقل البشري، هذا الأعجوبة البيولوجية المعقدة، هدفًا أسمى للعلماء والمهندسين. فمنذ…
في عالم البحث العلمي، حيث تُبنى المسيرة المهنية للعلماء على أساس الأصالة والدقة العلمية والاعتراف…
حكاية حقنة الأمل واليأس لم تكن حكاية على، الطفل المصاب بضمور العضلات الشوكي، والذي تبرع…