qileilove

          blog已經(jīng)轉(zhuǎn)移至github,大家請訪問 http://qaseven.github.io/

          SQL Server數(shù)據(jù)庫狀態(tài)監(jiān)控 - 可用空間

           數(shù)據(jù)庫用來存放數(shù)據(jù),那么肯定需要存儲空間,所以對磁盤空間的監(jiān)視自然就很有必要了。
            一. 磁盤可用空間
            1. 操作系統(tǒng)命令或腳本、接口或工具
            (1) DOS命令: fsutil volume diskfree
            C:\windows\system32>fsutil volume diskfree C:
            Total # of free bytes        : 9789493248
            Total # of bytes             : 64424505344
            Total # of avail free bytes  : 9789493248
            這里用到了fsutil,一個文件系統(tǒng)管理工具(file system utility),應(yīng)該還有其他一些命令或者腳本也是可以的。
            (2) WMI/WMIC: wmic logicaldisk
            WMI是個Windows系統(tǒng)的管理接口,在WMIC出現(xiàn)之前,如果要利用WMI管理系統(tǒng),必須使用一些專門的WMI應(yīng)用,例如SMS,或者使用WMI的腳本編程API,或者使用象CIM Studio之類的工具。如果不熟悉C++之類的編程語言或VBScript之類的腳本語言,或者不掌握WMI名稱空間的基本知識,要用WMI管理系統(tǒng)是很困難的。WMIC改變了這種情況,它為WMI名稱空間提供了一個強(qiáng)大的、友好的命令行接口。
            C:\windows\system32>wmic logicaldisk get caption,freespace,size
            Caption  FreeSpace     Size
            C:       9789071360    64424505344
            D:       189013438464  255331397632
            這里通過wmic的get命令獲取了logicaldisk 的幾個參數(shù)列。
            (3) 性能監(jiān)視器
            LogicalDisk: %Free Space
            LogicalDisk: Free Megabytes
            總大小 = LogicalDisk: Free Megabytes/ LogicalDisk: %Free Space
            性能監(jiān)視器雖然用于現(xiàn)場診斷還是挺方便的,但實現(xiàn)自動化監(jiān)控,并不太好用。
            2. SQL 語句
            (1) 擴(kuò)展存儲過程xp_cmdshell (還是在調(diào)用操作系統(tǒng)命令)
          DECLARE @Drive TINYINT,
          @SQL VARCHAR(100)
          DECLARE @Drives TABLE
          (
          Drive CHAR(1),
          Info VARCHAR(80)
          )
          SET @Drive = 97
          WHILE @Drive <= 122
          BEGIN
          SET @SQL = 'EXEC XP_CMDSHELL ''fsutil volume diskfree ' + CHAR(@Drive) + ':'''
          INSERT @Drives
          (
          Info
          )
          EXEC(@SQL)
          UPDATE @Drives
          SET Drive = CHAR(@Drive)
          WHERE Drive IS NULL
          SET @Drive = @Drive + 1
          END
          SELECT Drive,
          SUM(CASE WHEN Info LIKE 'Total # of bytes%' THEN CAST(REPLACE(SUBSTRING(Info, 32, 48), CHAR(13), '') AS BIGINT) ELSE CAST(0 AS BIGINT) END)/1024.0/1024/1024 AS TotalMBytes,
          SUM(CASE WHEN Info LIKE 'Total # of free bytes%' THEN CAST(REPLACE(SUBSTRING(Info, 32, 48), CHAR(13), '') AS BIGINT) ELSE CAST(0 AS BIGINT) END)/1024.0/1024/1024 AS FreeMBytes,
          SUM(CASE WHEN Info LIKE 'Total # of avail free bytes%' THEN CAST(REPLACE(SUBSTRING(Info, 32, 48), CHAR(13), '') AS BIGINT) ELSE CAST(0 AS BIGINT) END)/1024.0/1024/1024 AS AvailFreeMBytes
          FROM(
          SELECT Drive,
          Info
          FROM @Drives
          WHERE Info LIKE 'Total # of %'
          ) AS d
          GROUP BY Drive
          ORDER BY Drive
          xp_cmdshell可以執(zhí)行操作系統(tǒng)命令行,這段腳本用fsutil volume diskfree命令對26個字母的盤符遍歷了一遍,不是很好,改用wmic會方便些,如下:
            EXEC xp_cmdshell 'wmic logicaldisk get caption,freespace,size';
            (2) 擴(kuò)展存儲過程xp_fixeddrives
          --exec xp_fixeddrives
          IF object_id('tempdb..#drivefreespace') IS NOT NULL
          DROP TABLE #drivefreespace
          CREATE TABLE #drivefreespace(Drive CHAR(1), FreeMb bigint)
          INSERT #drivefreespace EXEC ('exec xp_fixeddrives')
          SELECT * FROM #drivefreespace
          Drive
          FreeMb
          C
          9316
          D
          180013
            總算不依賴操作系統(tǒng)命令了,不過,這個存儲過程只能返回磁盤可用空間,沒有磁盤總空間。
            (3) DMV/DMF: sys.dm_os_volume_stats
          SELECT DISTINCT
          @@SERVERNAME as [server]
          ,volume_mount_point as drive
          ,cast(available_bytes/ 1024.0 / 1024.0 / 1024.0 AS INT) as free_gb
          ,cast(total_bytes / 1024.0 / 1024.0 / 1024.0 AS INT) as total_gb
          FROM sys.master_files AS f
          CROSS APPLY sys.dm_os_volume_stats(f.database_id, f.file_id)
          ORDER BY @@SERVERNAME, volume_mount_point
          server
          drive
          free_gb
          total_gb
          C:\
          9
          59
          D:\
          175
          237
            從SQL Server 2008 R2 SP1開始,有了這個很好用的DMF: sys.dm_os_volume_stats,彌補(bǔ)了之前xp_fixeddrives沒有磁盤總空間的不足。
            不過,看它的參數(shù)就可以知道,沒被任何數(shù)據(jù)庫使用的磁盤,是查看不了的,所以xp_fixeddrives還有存在的必要。
            二. 數(shù)據(jù)庫可用空間
            1. 文件可用空間查看
            (1) 文件已用空間,當(dāng)前大小(已分配空間),最大值,如下:
          select @@SERVERNAME as server_name
          ,DB_NAME() as database_name
          ,case when data_space_id = 0 then 'LOG'
          else FILEGROUP_NAME(data_space_id)
          end as file_group
          ,name as logical_name
          ,physical_name
          ,type_desc
          ,FILEPROPERTY(name,'SpaceUsed')/128.0 as used_size_Mb
          ,size/128.0 as allocated_size_mb
          ,case when max_size = -1 then max_size
          else max_size/128.0
          end as max_size_Mb
          ,growth
          ,is_percent_growth
          from sys.database_files
          where state_desc = 'ONLINE'
            (2) 再算上磁盤的空閑空間,改動如下:
          select @@SERVERNAME as server_name
          ,DB_NAME() as database_name
          ,case when data_space_id = 0 then 'LOG'
          else FILEGROUP_NAME(data_space_id)
          end as file_group
          ,name as logical_name
          ,physical_name
          ,type_desc
          ,FILEPROPERTY(name,'SpaceUsed')/128.0 as used_size_mb
          ,size/128.0 as allocated_size_mb
          ,case when max_size = -1 then max_size
          else max_size/128.0
          end as max_size_mb
          ,vs.available_bytes/1024.0/1024 as disk_free_mb
          ,growth
          ,CAST(is_percent_growth as int) as is_percent_growth
          from sys.database_files df
          cross apply sys.dm_os_volume_stats(DB_ID(),df.file_id) vs
          where state_desc = 'ONLINE'
            如果是SQL Server 2008 SP1以前的版本,可用xp_fixeddrives生成磁盤空閑空間表,再進(jìn)行關(guān)聯(lián)。
            (3) 結(jié)合文件是否自增長,文件最大值,磁盤空間,算出文件可用空間比率,改動如下:
          select @@SERVERNAME as server_name
          ,DB_NAME() as database_name
          ,case when data_space_id = 0 then 'LOG'
          else FILEGROUP_NAME(data_space_id)
          end as file_group
          ,name as logical_name
          ,physical_name
          ,type_desc
          ,FILEPROPERTY(name,'SpaceUsed')/128.0 as used_size_mb
          ,size/128.0 as allocated_size_mb
          ,case when max_size = -1 then max_size
          else max_size/128.0
          end as max_size_mb
          ,vs.available_bytes/1024.0/1024 as disk_free_mb
          ,case when growth = 0 then  (size - FILEPROPERTY(name,'SpaceUsed'))*1.0/size
          when growth > 0 and max_size = -1 then ((size/128.0 + vs.available_bytes/1024.0/1024) - FILEPROPERTY(name,'SpaceUsed')/128.0)/(size/128.0 + vs.available_bytes/1024.0/1024)
          when growth > 0 and max_size <> -1 and (max_size/128.0 - vs.available_bytes/1024.0/1024) >= 0 then ((size/128.0 + vs.available_bytes/1024.0/1024) - FILEPROPERTY(name,'SpaceUsed')/128.0)/(size/128.0 + vs.available_bytes/1024.0/1024)
          when growth > 0 and max_size <> -1 and (max_size/128.0 - vs.available_bytes/1024.0/1024) <  0 then (max_size - FILEPROPERTY(name,'SpaceUsed'))*1.0/max_size
          else null
          end as free_space_percent
          ,growth
          ,CAST(is_percent_growth as int) as is_percent_growth
          from sys.database_files df
          cross apply sys.dm_os_volume_stats(DB_ID(),df.file_id) vs
          where state_desc = 'ONLINE'
          (4) 如果有多個數(shù)據(jù)庫,注意fileproperty()和filegroup_name()函數(shù),都只在當(dāng)前數(shù)據(jù)庫下生效,改動如下:
          if object_id('tempdb..#tmp_filesize') is not null
          drop table #tmp_filesize
          GO
          create table #tmp_filesize
          (
          server_name          varchar(256),
          database_name        varchar(256),
          file_group           varchar(256),
          logical_name         varchar(256),
          physical_name        varchar(1024),
          type_desc            varchar(128),
          used_size_mb         float,
          allocated_size_mb    float,
          max_size_mb          float,
          disk_free_mb         float,
          free_space_percent   float,
          growth               int,
          is_percent_growth    int
          )
          GO
          exec sp_msforeachdb 'use [?]
          insert into #tmp_filesize
          select @@SERVERNAME as server_name
          ,DB_NAME() as database_name
          ,case when data_space_id = 0 then ''LOG''
          else FILEGROUP_NAME(data_space_id)
          end as file_group
          ,name as logical_name
          ,physical_name
          ,type_desc
          ,FILEPROPERTY(name,''SpaceUsed'')/128.0 as used_size_mb
          ,size/128.0 as allocated_size_mb
          ,case when max_size = -1 then max_size
          else max_size/128.0
          end as max_size_mb
          ,vs.available_bytes/1024.0/1024 as disk_free_mb
          ,case when growth = 0 then  (size - FILEPROPERTY(name,''SpaceUsed''))*1.0/size
          when growth > 0 and max_size = -1 then ((size/128.0 + vs.available_bytes/1024.0/1024) - FILEPROPERTY(name,''SpaceUsed'')/128.0)/(size/128.0 + vs.available_bytes/1024.0/1024)
          when growth > 0 and max_size <> -1 and (max_size/128.0 - vs.available_bytes/1024.0/1024) >= 0 then ((size/128.0 + vs.available_bytes/1024.0/1024) - FILEPROPERTY(name,''SpaceUsed'')/128.0)/(size/128.0 + vs.available_bytes/1024.0/1024)
          when growth > 0 and max_size <> -1 and (max_size/128.0 - vs.available_bytes/1024.0/1024) <  0 then (max_size - FILEPROPERTY(name,''SpaceUsed''))*1.0/max_size
          else null
          end as free_space_percent
          ,growth
          ,CAST(is_percent_growth as int) as is_percent_growth
          from sys.database_files df
          cross apply sys.dm_os_volume_stats(DB_ID(),df.file_id) vs
          where state_desc = ''ONLINE'''
          select * from #tmp_filesize
            2. 數(shù)據(jù)庫可用空間告警
            2.1 告警的格式
            數(shù)據(jù)庫可用空間告警,通常不告警某個文件,也不告警整個數(shù)據(jù)庫,而是某個確切的文件組/表空間,日志文件是沒有文件組的,所有可以把日志文件合并為LOG這個組。
            (1) Oracle可以給表空間設(shè)置最大尺寸,表空間里的每個文件逐個使用,直到最后一個文件也沒空間時,就會提示空間不足;
            (2) SQL Server 無法對文件組設(shè)置最大尺寸,只可以給文件組里每個文件指定最大尺寸,所以要先統(tǒng)計:是否當(dāng)前文件組下所有的文件都已經(jīng)滿了?
            將同一個文件組/LOG下的所有文件都檢查一下,如果所有文件都滿了(以20%為例),那么就滿足告警條件了,如下:
            --#tmp_filesize 在上面的腳本里生成了
            select server_name,
            database_name,
            file_group,
            MAX(free_space_percent) as max_free_space_percent
            from #tmp_filesize
            group by server_name,database_name,file_group
            having MAX(free_space_percent) <= 0.2 --20%
            郵件告警的格式大致為:
            郵件標(biāo)題:主機(jī)名\實例名\數(shù)據(jù)庫名\文件組名,@@servername已經(jīng)包含了SQL Server實例名;
            郵件內(nèi)容:文件組 ”file group name” 空間不足,已低于20%。
            2.2 告警后如何處理?
            (1) 告警中的文件組里的文件,所在的磁盤還有空間嗎?
            exec xp_fixeddrives
            如果當(dāng)前磁盤沒空間,可以給當(dāng)前文件組在其他磁盤上添加新的文件,并關(guān)閉老的文件自增長或限制最大值;
            如果所有磁盤都沒空間,可以考慮刪除磁盤上的其他文件,或者收縮數(shù)據(jù)庫文件(數(shù)據(jù)/日志),或者磁盤擴(kuò)展空間(加磁盤)。
            (2) 如果磁盤有空間,文件是否關(guān)閉了自動增長?
            可能是在創(chuàng)建文件時,給了文件比較大的size,如500G,并關(guān)閉了文件自動增長;
            ALTER DATABASE test
            ADD FILE
            (
            NAME = test_02,
            FILENAME = 'D:\Program Files (x86)\Microsoft SQL Server\MSSQL10_50.MSSQLSERVER\MSSQL\DATA\test_02.ndf',
            SIZE = 500 GB,
            FILEGROWTH = 0
            )
            TO FILEGROUP [PRIMARY];
            GO
            (3) 如果磁盤有空間,自動增長也開了,是不是限制了文件最大值?
            限制最大值和關(guān)閉自增長,應(yīng)該都是不想單個文件變得太大,個人覺得一個文件控制在500G以內(nèi)比較合理,這兩種情況,都建議擴(kuò)展一個新文件。
            小結(jié)
            如果沒有監(jiān)控工具,那么可選擇系統(tǒng)視圖,擴(kuò)展存儲過程,結(jié)合數(shù)據(jù)庫郵件的方式,作自動檢查,并告警文件組/日志空閑空間不足。大致步驟如下 :
            (1) 部署數(shù)據(jù)庫郵件;
            (2) 部署作業(yè):定時檢查文件組/日志空閑空間,發(fā)郵件告警。
          English »
           

          posted on 2014-09-19 13:23 順其自然EVO 閱讀(515) 評論(0)  編輯  收藏 所屬分類: 測試學(xué)習(xí)專欄數(shù)據(jù)庫

          <2014年9月>
          31123456
          78910111213
          14151617181920
          21222324252627
          2829301234
          567891011

          導(dǎo)航

          統(tǒng)計

          常用鏈接

          留言簿(55)

          隨筆分類

          隨筆檔案

          文章分類

          文章檔案

          搜索

          最新評論

          閱讀排行榜

          評論排行榜

          主站蜘蛛池模板: 古交市| 内江市| 承德市| 旬邑县| 勃利县| 湟中县| 额敏县| 惠东县| 鹿泉市| 栖霞市| 冕宁县| 黄平县| 响水县| 同江市| 普格县| 渝中区| 扎囊县| 毕节市| 武宣县| 庆云县| 霞浦县| 涿鹿县| 镇原县| 德钦县| 兴业县| 陇西县| 铜梁县| 沈阳市| 东至县| 庆阳市| 平潭县| 大关县| 长沙县| 广安市| 诏安县| 内乡县| 连州市| 株洲市| 惠州市| 炉霍县| 隆子县|