<rss xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title>Optimization - Tag - Zhiverse</title><link>https://yao-chih.netlify.app/en/tags/optimization/</link><description>Optimization - Tag - Zhiverse</description><generator>Hugo -- gohugo.io</generator><language>en</language><managingEditor>yaochihh@gmail.com (Josh)</managingEditor><webMaster>yaochihh@gmail.com (Josh)</webMaster><copyright>Zhiverse</copyright><atom:link href="https://yao-chih.netlify.app/en/tags/optimization/" rel="self" type="application/rss+xml"/><item><title>Spatiotemporal Prediction of Unknown Areas Based on Structured State Space Diffusion and Resolution Adaptive Fixed Rank Kriging</title><link>https://yao-chih.netlify.app/en/spatiotemporal-prediction-of-unknown-areas-based-on-structured-state-space-diffusion-and-resolution-adaptive-fixed-rank-kriging/</link><pubDate>Tue, 28 Jul 2026 00:00:00 +0800</pubDate><author>Author</author><guid>https://yao-chih.netlify.app/en/spatiotemporal-prediction-of-unknown-areas-based-on-structured-state-space-diffusion-and-resolution-adaptive-fixed-rank-kriging/</guid><description><![CDATA[<div class="details admonition info open">
        <div class="details-summary admonition-title">
            <i class="icon fas fa-info-circle fa-fw" aria-hidden="true"></i>Abstract<i class="details-icon fas fa-angle-right fa-fw" aria-hidden="true"></i>
        </div>
        <div class="details-content">
            <div class="admonition-content"><p>With the rapid advancement of sensing and remote sensing technologies, data collected in transportation, meteorology, and environmental monitoring have become increasingly characterized by high-frequency observations and cross-regional spatiotemporal dependencies. However, missing observations, irregular sampling, and prediction at unobserved locations remain major challenges for spatiotemporal forecasting. To address these issues, this study proposes a spatiotemporal forecasting framework, $\text{SSSD}^{\text{S4+MRTS}}$ + AFRK, which integrates Structured State Space Diffusion Model with S4 Layers ($\text{SSSD}^{\text{S4}}$) and Multi-Resolution Thin-Plate Spline (MRTS) basis functions to jointly model long-range temporal dependencies and spatial structural patterns. MRTS is incorporated into the S4 layers as additional spatial conditioning information, enabling $\text{SSSD}^{\text{S4+MRTS}}$ to learn spatiotemporal dynamics conditioned on observed locations. During inference, the framework further integrates MRTS-based Resolution Adaptive Fixed Rank Kriging (AFRK), which preserves the spatial consistency of the predicted field while enabling interpolation at unobserved locations. Experiments conducted on the Weather2K, MERRA-2, and the dataset from The Second Competition on Spatial Statistics for Large Datasets are used to compare the proposed framework with Temporal Fusion Transformers (TFT), Vector Autoregression (VAR), Stochastic Variational Gaussian Process (SVGP), and Spatio-temporal DeepKriging (STDK). The results demonstrate that $\text{SSSD}^{\text{S4+MRTS}}$ generally improves Mean Squared Prediction Error (MSPE) under most experimental settings, with particularly notable gains in future forecasting at unobserved locations. Overall, the findings indicate that integrating temporal dynamic modeling with spatial statistical methods effectively enhances spatiotemporal forecasting performance under missing-data and spatial extrapolation scenarios.</p>
<p><strong>Keywords</strong>: Structured State Space Diffusion Model, Multi-Resolution Thin-Plate Spline Basis Functions, Resolution Adaptive Fixed Rank Kriging, spatiotemporal forecasting, spatial interpolation, missing data imputation</p>
</div>
        </div>
    </div>]]></description></item><item><title>From Gradient Descent to Stochastic Gradient Descent</title><link>https://yao-chih.netlify.app/en/from-gradient-descent-to-stochastic-gradient-descent/</link><pubDate>Sat, 30 Aug 2025 10:54:32 +0800</pubDate><author>Author</author><guid>https://yao-chih.netlify.app/en/from-gradient-descent-to-stochastic-gradient-descent/</guid><description><![CDATA[<div class="featured-image">
                <img src="https://raw.githubusercontent.com/Josh-test-lab/website-assets-repository/refs/heads/main/posts/From%20Gradient%20Descent%20to%20Stochastic%20Gradient%20Descent/cover%20image.webp" referrerpolicy="no-referrer">
            </div><p>Cover image was generated by ChatGPT.</p>
<p>Gradient descent is an iterative method used in most modern models to help find optimal parameters. However, in today&rsquo;s era of big data, the massive amount of data results in significant time costs for gradient descent. One key goal is to compute parameters quickly without sacrificing accuracy.</p>]]></description></item></channel></rss>