Sep 30 15:25:49 devstack cinder-volume[72129]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:25:49 devstack cinder-volume[72129]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:25:49 devstack cinder-volume[72129]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO dbcounter [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Registered counter for database cinder
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_db.sqlalchemy.engines [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG dbcounter [-] [72129] Writer thread running {{(pid=72129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.rpc [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.rpc [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_db.sqlalchemy.engines [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.volume.manager [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Determined volume DB was empty at startup.
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG cinder.volume.manager [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72129) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.volume.manager [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 30 15:25:50 devstack cinder-volume[72129]: WARNING stevedore.named [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 15:25:50 devstack cinder-volume[72129]: WARNING castellan.key_manager [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:25:50 devstack cinder-volume[72129]: WARNING cinder.keymgr.conf_key_mgr [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG cinder.volume.drivers.lvm [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72129) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_concurrency.processutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_concurrency.processutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] CMD "cinder-rtstool verify" returned: 0 in 0.295s {{(pid=72129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_db.sqlalchemy.engines [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.rpc [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.rpc [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 30 15:25:50 devstack cinder-volume[72129]: WARNING stevedore.named [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 15:25:50 devstack cinder-volume[72129]: WARNING castellan.key_manager [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO cinder.volume.manager [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_db.sqlalchemy.engines [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:25:50 devstack cinder-volume[72129]: INFO oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Starting 1 workers
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Started child 72679 {{(pid=72129) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Full set of CONF: {{(pid=72129) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] ******************************************************************************** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Configuration options gathered from: {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] ================================================================================ {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] allow_availability_zone_fallback = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] allow_compression_on_image_upload = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] allowed_direct_url_schemes     = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] api_rate_limit                 = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] auth_strategy                  = keystone {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] az_cache_duration              = 3600 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_availability_zone      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_host                   = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_name                   = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_stats_polling_interval = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backup_api_class               = cinder.backup.api.API {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backup_name_template           = backup-%s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backup_use_same_host           = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backup_use_temp_snapshot       = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] chap_password                  = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] chap_username                  =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_internal_tenant_project_id = df7733a9d7e149dfb8c3973f820cbc7d {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_internal_tenant_user_id = 4cfd70f3bdbd4df49ef487258c938f66 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cloned_volume_same_az          = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cluster                        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] compression_format             = gzip {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] compute_api_class              = cinder.compute.nova.API {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] config_dir                     = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] config_source                  = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] control_exchange               = openstack {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] debug                          = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] default_availability_zone      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] default_group_type             = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] default_volume_type            = lvmdriver-1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] driver_client_cert             = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] driver_client_cert_key         = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] driver_data_namespace          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] driver_ssl_cert_path           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] driver_ssl_cert_verify         = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] driver_use_ssl                 = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] enable_force_upload            = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] enable_new_services            = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] enable_unsupported_driver      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: INFO cinder.volume.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] enforce_multipath_for_image_xfer = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] filter_function                = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_api_insecure            = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_api_servers             = ['http://192.168.122.100/image'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_api_ssl_compression     = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_ca_certificates_file    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_catalog_info            = image:glance:publicURL {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_certfile                = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_keyfile                 = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_num_retries             = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance_request_timeout         = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] goodness_function              = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] graceful_shutdown_timeout      = 5 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] group_api_class                = cinder.group.api.API {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] host                           = devstack {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_compress_on_upload       = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_conversion_address_space_limit = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_conversion_cpu_limit     = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_conversion_disable       = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_upload_use_cinder_backend = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_upload_use_internal_tenant = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_volume_cache_enabled     = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_volume_cache_max_count   = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] image_volume_cache_max_size_gb = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] init_host_max_objects_retrieval = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] instance_format                = [instance: %(uuid)s]  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iscsi_iotype                   = fileio {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iscsi_target_flags             =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iscsi_write_cache              = on {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iser_helper                    = tgtadm {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iser_ip_address                = 192.168.122.100 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iser_port                      = 3260 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_color                      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_config_append              = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_dir                        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_file                       = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_options                    = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_rotate_interval            = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_rotate_interval_type       = days {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] log_rotation_type              = none {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] max_age                        = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] max_logfile_count              = 30 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] max_logfile_size_mb            = 200 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] max_over_subscription_ratio    = 20.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] message_reap_interval          = 86400 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] message_ttl                    = 2592000 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] migration_create_volume_timeout_secs = 300 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] monkey_patch                   = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] monkey_patch_modules           = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] my_ip                          = 192.168.122.100 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] no_snapshot_gb_quota           = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] num_iser_scan_tries            = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] num_shell_tries                = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] num_volume_device_scan_tries   = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] nvmeof_conn_info_version       = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] nvmet_ns_id                    = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] nvmet_port_id                  = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_max_limit                = 1000 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_volume_ext_list          = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_volume_listen_port       = 8776 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_volume_use_ssl           = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] osapi_volume_workers           = 2 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] per_volume_size_limit          = -1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] periodic_fuzzy_delay           = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] periodic_interval              = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] public_endpoint                = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] publish_errors                 = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_backup_gigabytes         = 1000 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_backups                  = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_gigabytes                = 1000 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_groups                   = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_snapshots                = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] quota_volumes                  = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] rate_limit_burst               = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] rate_limit_except_level        = CRITICAL {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] rate_limit_interval            = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] reinit_driver_count            = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] replication_device             = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] report_discard_supported       = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] report_interval                = 120 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] reservation_clean_interval     = 86400 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] reservation_expire             = 86400 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] reserved_image_namespaces      = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] reserved_percentage            = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] rpc_response_timeout           = 120 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] run_external_periodic_tasks    = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] scst_target_driver             = iscsi {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] scst_target_iqn_name           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_down_time              = 720 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] shell_completion               = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] snapshot_name_template         = snapshot-%s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] snapshot_same_host             = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] split_loggers                  = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] state_path                     = /opt/stack/data/cinder {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] storage_availability_zone      = nova {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] storage_protocol               = iSCSI {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] syslog_log_facility            = LOG_USER {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] target_helper                  = lioadm {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] target_ip_address              = 192.168.122.100 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:50 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] target_port                    = 3260 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] target_protocol                = iscsi {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] target_secondary_ip_addresses  = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] trace_flags                    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] transport_url                  = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] until_refresh                  = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_chap_auth                  = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_default_quota_class        = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_journal                    = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_json                       = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_multipath_for_image_xfer   = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_stderr                     = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] use_syslog                     = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] verify_glance_signatures       = enabled {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_api_class               = cinder.volume.api.API {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_backend_name            = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_clear                   = zero {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_clear_ionice            = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_clear_size              = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_copy_bps_limit          = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_dd_blocksize            = 1M {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_name_template           = volume-%s {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_service_inithost_offload = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volume_usage_audit_period      = month {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] watch_log_file                 = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] zoning_mode                    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_concurrency.disable_process_locking = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.admin_password = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.admin_token = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.admin_user  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_port   = 35357 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_protocol = https {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_section = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_type   = password {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_uri    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.auth_version = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.cache       = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.certfile    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.delay_auth_decision = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.http_connect_timeout = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack sudo[72705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 30 15:25:51 devstack sudo[72705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.identity_uri = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.include_service_catalog = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.insecure    = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.interface   = public {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.keyfile     = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_password =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcache_username =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.region_name = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.service_token_roles_required = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.service_type = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.token_cache_time = 300 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] keystone_authtoken.www_authenticate_uri = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.backend                  = dogpile.cache.null {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.backend_argument         = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.backend_expiration_time  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.config_prefix            = cache.oslo {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.dead_timeout             = 60.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.debug_cache_backend      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.enable_retry_client      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.enable_socket_keepalive  = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.enabled                  = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.enforce_fips_mode        = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.expiration_time          = 600 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.hashclient_retry_attempts = 2 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_dead_retry      = 300 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_password        = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_pool_maxsize    = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_sasl_enabled    = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.memcache_username        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.proxies                  = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_db                 = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_password           = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_sentinel_service_name = mymaster {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_server             = localhost:6379 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_socket_timeout     = 1.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.redis_username           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.retry_attempts           = 2 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.retry_delay              = 0.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.socket_keepalive_count   = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.socket_keepalive_idle    = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.socket_keepalive_interval = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.tls_allowed_ciphers      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.tls_cafile               = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.tls_certfile             = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.tls_enabled              = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cache.tls_keyfile              = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] coordination.backend_url       = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.asyncio_connection    = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.asyncio_slave_connection = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.backend               = sqlalchemy {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.connection            = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.connection_debug      = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.connection_parameters =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.connection_recycle_time = 3600 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.connection_trace      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.db_inc_retry_interval = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.db_max_retries        = 20 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.db_max_retry_interval = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.db_retry_interval     = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.max_overflow          = 50 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.max_pool_size         = 5 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.max_retries           = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.mysql_wsrep_sync_wait = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.pool_timeout          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.retry_interval        = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.slave_connection      = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.sqlite_synchronous    = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] database.use_db_reconnect      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.connection_string     = messaging:// {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.enabled               = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.es_doc_type           = notification {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.es_scroll_size        = 10000 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.es_scroll_time        = 2m {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.filter_error_trace    = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.hmac_keys             = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.sentinel_service_name = mymaster {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.socket_timeout        = 0.1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.trace_requests        = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler.trace_sqlalchemy      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler_jaeger.process_tags   = {} {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler_jaeger.service_name_prefix = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] profiler_otlp.service_name_prefix = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.enforce_new_defaults = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: WARNING oslo_config.cfg [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.enforce_scope      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.policy_default_rule = default {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.policy_file        = policy.yaml {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.group          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.helper_command = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] privsep_osbrick.user           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.group         = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.helper_command = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] cinder_sys_admin.user          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.auth_section      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.auth_type         = password {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.certfile          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.collect_timing    = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.insecure          = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.keyfile           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.send_service_user_token = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.split_loggers     = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] service_user.timeout           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.auth_section            = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.auth_type               = password {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.certfile                = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.collect_timing          = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.insecure                = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.keyfile                 = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.split_loggers           = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] glance.timeout                 = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.backend_availability_zone = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.chap_password = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.chap_username =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.driver_client_cert = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.driver_client_cert_key = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.driver_data_namespace = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.driver_use_ssl = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.enable_unsupported_driver = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.extra_capabilities = {} {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.filter_function = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.goodness_function = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iscsi_iotype  = fileio {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iscsi_target_flags =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iscsi_write_cache = on {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iser_helper   = tgtadm {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iser_port     = 3260 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.lvm_share_target = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.lvm_type      = auto {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.num_shell_tries = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.nvmet_port_id = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.replication_device = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.report_discard_supported = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.reserved_percentage = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.scst_target_driver = iscsi {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.scst_target_iqn_name = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.storage_protocol = iSCSI {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.target_helper = tgtadm {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.target_port   = 3260 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.target_protocol = iscsi {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.trace_flags   = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.unique_fqdn_network = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.use_chap_auth = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_backend_name = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_clear  = zero {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_clear_ionice = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_clear_size = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_reports.file_event_handler = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_reports.log_dir           = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.backend_availability_zone = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.backend_host       = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.chap_password      = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.chap_username      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.driver_client_cert = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.driver_data_namespace = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.extra_capabilities = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.filter_function    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.goodness_function  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iscsi_iotype       = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iser_helper        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iser_ip_address    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iser_port          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.iser_target_prefix = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.lvm_share_target   = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.lvm_type           = auto {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.num_shell_tries    = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.replication_device = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.report_discard_supported = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.reserved_percentage = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.scst_target_driver = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.storage_protocol   = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.target_helper      = lioadm {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.target_ip_address  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.target_port        = 3260 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.trace_flags        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.use_chap_auth      = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_clear       = zero {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_clear_size  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] lvmdriver-1.volumes_dir        = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.ssl      = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_notifications.driver = [] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_notifications.retry = -1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] oslo_messaging_notifications.transport_url = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] key_manager.fixed_key          = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.barbican_api_version  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.barbican_endpoint     = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.barbican_endpoint_type = public {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.barbican_region_name  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.cafile                = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.certfile              = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.collect_timing        = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.insecure              = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.keyfile               = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.number_of_retries     = 60 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.retry_delay           = 1 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.send_service_user_token = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.split_loggers         = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.timeout               = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.verify_ssl            = True {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican.verify_ssl_path       = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.auth_section = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.auth_type = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.cafile   = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.certfile = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.collect_timing = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.insecure = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.keyfile  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.split_loggers = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] barbican_service_user.timeout  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.approle_role_id          = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.approle_secret_id        = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.kv_mountpoint            = secret {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.kv_path                  = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.kv_version               = 2 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.namespace                = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.root_token_id            = **** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.ssl_ca_crt_file          = None {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.timeout                  = 60.0 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.use_ssl                  = False {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:25:51 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] ******************************************************************************** {{(pid=72129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 30 15:25:51 devstack sudo[72705]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:51 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.546s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:51 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:51 devstack sudo[72943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:51 devstack sudo[72943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:52 devstack sudo[72943]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.515s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:25:52 devstack cinder-volume[72679]: INFO cinder.brick.local_dev.lvm [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:52 devstack sudo[73159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:25:52 devstack sudo[73159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:52 devstack sudo[73159]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG cinder.brick.local_dev.lvm [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72679) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 30 15:25:52 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:52 devstack sudo[73232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:52 devstack sudo[73232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:53 devstack sudo[73232]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:53 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.815s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:53 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:53 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:53 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:53 devstack sudo[73361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:53 devstack sudo[73361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:54 devstack sudo[73361]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:54 devstack sudo[73365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 30 15:25:54 devstack sudo[73365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:54 devstack sudo[73365]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.470s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:54 devstack sudo[73368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:25:54 devstack sudo[73368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:54 devstack sudo[73368]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:54 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:54 devstack sudo[73376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:25:54 devstack sudo[73376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:55 devstack sudo[73376]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:55 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:55 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:55 devstack sudo[73380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:25:55 devstack sudo[73380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:55 devstack sudo[73380]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:55 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:55 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:55 devstack sudo[73385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:55 devstack sudo[73385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:56 devstack sudo[73385]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:56 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:56 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:56 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:56 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:56 devstack sudo[73389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:56 devstack sudo[73389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:56 devstack sudo[73389]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:56 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:56 devstack cinder-volume[72679]: INFO cinder.volume.drivers.lvm [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 30 15:25:56 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:57 devstack sudo[73504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:57 devstack sudo[73504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:57 devstack sudo[73504]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG cinder.volume.drivers.lvm [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Updating volume stats {{(pid=72679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:57 devstack sudo[73514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:25:57 devstack sudo[73514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:57 devstack sudo[73514]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:57 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:58 devstack sudo[73652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:25:58 devstack sudo[73652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:58 devstack sudo[73652]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:58 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:58 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:58 devstack sudo[73655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:25:58 devstack sudo[73655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:58 devstack sudo[73655]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:58 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:58 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:58 devstack sudo[73661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:25:58 devstack sudo[73661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:25:59 devstack sudo[73661]: pam_unix(sudo:session): session closed for user root
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:25:59 devstack cinder-volume[72679]: INFO cinder.volume.driver [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG cinder.volume.driver [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72679) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG oslo_db.sqlalchemy.engines [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72679) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG dbcounter [-] [72679] Writer thread running {{(pid=72679) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG cinder.db.sqlalchemy.api [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Building query based on filter {{(pid=72679) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG cinder.image.image_utils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72679) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 30 15:25:59 devstack cinder-volume[72679]: INFO cinder.keymgr.migration [None req-667e1e1d-cc2d-45ac-95d8-a0f4c38517f0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG cinder.volume.drivers.lvm [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Updating volume stats {{(pid=72679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 15:25:59 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:25:59 devstack sudo[73666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:25:59 devstack sudo[73666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:00 devstack sudo[73666]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:00 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:00 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:00 devstack sudo[73670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:26:00 devstack sudo[73670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:00 devstack sudo[73670]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:00 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.549s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:00 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:00 devstack sudo[73674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:26:00 devstack sudo[73674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:00 devstack cinder-volume[72129]: DEBUG dbcounter [-] [72129] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:26:01 devstack sudo[73674]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:01 devstack sudo[73683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:26:01 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:01 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG cinder.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Notifying Schedulers of capabilities ... {{(pid=72679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:26:01 devstack cinder-volume[72679]: INFO cinder.volume.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Driver initialization completed successfully.
Sep 30 15:26:01 devstack cinder-volume[72679]: INFO cinder.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Initiating service 2 cleanup
Sep 30 15:26:01 devstack cinder-volume[72679]: INFO cinder.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Service 2 cleanup completed.
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG cinder.service [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Creating RPC server for service cinder-volume {{(pid=72679) start /opt/stack/cinder/cinder/service.py:239}}
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG cinder.service [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72679) start /opt/stack/cinder/cinder/service.py:245}}
Sep 30 15:26:01 devstack cinder-volume[72679]: INFO cinder.volume.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG cinder.volume.drivers.lvm [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Updating volume stats {{(pid=72679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 15:26:01 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:01 devstack sudo[73687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:26:01 devstack sudo[73687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:02 devstack sudo[73687]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:02 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:02 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:02 devstack sudo[73744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:26:02 devstack sudo[73744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:02 devstack sudo[73744]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:02 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:02 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:02 devstack sudo[73747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:26:02 devstack sudo[73747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:03 devstack sudo[73747]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:03 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:03 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:26:03 devstack sudo[73869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:26:03 devstack sudo[73869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:26:03 devstack sudo[73869]: pam_unix(sudo:session): session closed for user root
Sep 30 15:26:03 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:26:03 devstack cinder-volume[72679]: INFO cinder.volume.manager [None req-dd8f2bde-c784-40b6-947c-2e09d830f7ab None None] Driver post RPC initialization completed successfully.
Sep 30 15:26:13 devstack cinder-volume[72679]: DEBUG dbcounter [-] [72679] Writing DB stats cinder:SELECT=3 {{(pid=72679) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:26:13 devstack cinder-volume[72679]: DEBUG dbcounter [-] [72679] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72679) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:27:38 devstack cinder-volume[72679]: DEBUG oslo_service.periodic_task [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72679) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:27:38 devstack cinder-volume[72679]: DEBUG cinder.volume.drivers.lvm [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Updating volume stats {{(pid=72679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 15:27:38 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:27:38 devstack sudo[78827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 15:27:38 devstack sudo[78827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:27:39 devstack sudo[78827]: pam_unix(sudo:session): session closed for user root
Sep 30 15:27:39 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:27:39 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:27:39 devstack sudo[78830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:27:39 devstack sudo[78830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:27:39 devstack sudo[78830]: pam_unix(sudo:session): session closed for user root
Sep 30 15:27:39 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:27:39 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:27:39 devstack sudo[78835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 15:27:39 devstack sudo[78835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:27:39 devstack sudo[78835]: pam_unix(sudo:session): session closed for user root
Sep 30 15:27:39 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:27:39 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:27:39 devstack sudo[78839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 15:27:39 devstack sudo[78839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:27:40 devstack sudo[78839]: pam_unix(sudo:session): session closed for user root
Sep 30 15:27:40 devstack cinder-volume[72679]: DEBUG oslo_concurrency.processutils [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:27:40 devstack cinder-volume[72679]: DEBUG cinder.manager [None req-14253fbe-195b-4426-9a32-174bae1a06be None None] Notifying Schedulers of capabilities ... {{(pid=72679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:28:13 devstack cinder-volume[72679]: DEBUG dbcounter [-] [72679] Writing DB stats cinder:SELECT=1 {{(pid=72679) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:28:13 devstack cinder-volume[72679]: DEBUG dbcounter [-] [72679] Writing DB stats cinder:UPDATE=1 {{(pid=72679) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:28:26 devstack cinder-volume[72129]: INFO oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Caught SIGTERM, stopping children
Sep 30 15:28:26 devstack cinder-volume[72129]: DEBUG oslo_concurrency.lockutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Acquiring lock "singleton_lock" {{(pid=72129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:28:26 devstack cinder-volume[72129]: DEBUG oslo_concurrency.lockutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Acquired lock "singleton_lock" {{(pid=72129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:28:26 devstack cinder-volume[72129]: DEBUG oslo_concurrency.lockutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Releasing lock "singleton_lock" {{(pid=72129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:28:26 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Stop services. {{(pid=72129) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 30 15:28:26 devstack cinder-volume[72129]: DEBUG oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Killing children. {{(pid=72129) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 30 15:28:26 devstack cinder-volume[72129]: INFO oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Waiting on 1 children to exit
Sep 30 15:28:26 devstack cinder-volume[72679]: DEBUG oslo_concurrency.lockutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Acquiring lock "singleton_lock" {{(pid=72679) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:28:26 devstack cinder-volume[72679]: DEBUG oslo_concurrency.lockutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Acquired lock "singleton_lock" {{(pid=72679) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:28:26 devstack cinder-volume[72679]: DEBUG oslo_concurrency.lockutils [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Releasing lock "singleton_lock" {{(pid=72679) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:28:26 devstack cinder-volume[72679]: WARNING amqp [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 15:28:26 devstack cinder-volume[72679]: WARNING amqp [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 15:28:26 devstack cinder-volume[72129]: INFO oslo_service.backend._eventlet.service [None req-aff62173-ed8e-4402-a80c-ecdab5c9bc9a None None] Child 72679 exited with status 0
Sep 30 15:28:28 devstack cinder-volume[79963]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=79963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:28:28 devstack cinder-volume[79963]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=79963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:28:28 devstack cinder-volume[79963]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=79963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:28:28 devstack cinder-volume[79963]: INFO dbcounter [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Registered counter for database cinder
Sep 30 15:28:28 devstack cinder-volume[79963]: DEBUG oslo_db.sqlalchemy.engines [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG dbcounter [-] [79963] Writer thread running {{(pid=79963) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 15:28:29 devstack cinder-volume[79963]: INFO cinder.rpc [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 15:28:29 devstack cinder-volume[79963]: INFO cinder.rpc [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_db.sqlalchemy.engines [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:29 devstack cinder-volume[79963]: INFO cinder.volume.manager [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Determined volume DB was empty at startup.
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG cinder.volume.manager [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=79963) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 30 15:28:29 devstack cinder-volume[79963]: INFO cinder.volume.manager [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 30 15:28:29 devstack cinder-volume[79963]: WARNING stevedore.named [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 15:28:29 devstack cinder-volume[79963]: WARNING castellan.key_manager [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:28:29 devstack cinder-volume[79963]: WARNING cinder.keymgr.conf_key_mgr [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:28:29 devstack cinder-volume[79963]: INFO cinder.volume.manager [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_db.sqlalchemy.engines [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:29 devstack cinder-volume[79963]: INFO oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Starting 1 workers
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Started child 80056 {{(pid=79963) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Full set of CONF: {{(pid=79963) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] ******************************************************************************** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Configuration options gathered from: {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] ================================================================================ {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] allow_availability_zone_fallback = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] allow_compression_on_image_upload = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] allowed_direct_url_schemes     = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] api_rate_limit                 = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] auth_strategy                  = keystone {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_availability_zone      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_host                   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_name                   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_stats_polling_interval = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backup_api_class               = cinder.backup.api.API {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backup_name_template           = backup-%s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backup_use_same_host           = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backup_use_temp_snapshot       = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[80056]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] chap_password                  = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] chap_username                  =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_internal_tenant_project_id = df7733a9d7e149dfb8c3973f820cbc7d {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_internal_tenant_user_id = 4cfd70f3bdbd4df49ef487258c938f66 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cluster                        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] compression_format             = gzip {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] compute_api_class              = cinder.compute.nova.API {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] config_dir                     = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] config_source                  = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] control_exchange               = openstack {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] debug                          = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] default_availability_zone      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] default_group_type             = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] default_volume_type            = QuobyteHD {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] driver_client_cert             = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] driver_client_cert_key         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] driver_data_namespace          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] driver_ssl_cert_path           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] driver_ssl_cert_verify         = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] driver_use_ssl                 = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] enable_new_services            = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] enable_unsupported_driver      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] enabled_backends               = ['QuobyteHD'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] enforce_multipath_for_image_xfer = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] filter_function                = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_api_insecure            = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_api_servers             = ['http://192.168.122.100/image'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_api_ssl_compression     = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_ca_certificates_file    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_catalog_info            = image:glance:publicURL {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_certfile                = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_keyfile                 = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_num_retries             = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance_request_timeout         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] goodness_function              = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] graceful_shutdown_timeout      = 5 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] group_api_class                = cinder.group.api.API {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] host                           = devstack {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_compress_on_upload       = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_conversion_address_space_limit = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_conversion_cpu_limit     = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_conversion_disable       = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_upload_use_cinder_backend = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_upload_use_internal_tenant = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_volume_cache_enabled     = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_volume_cache_max_count   = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] image_volume_cache_max_size_gb = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] init_host_max_objects_retrieval = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] instance_format                = [instance: %(uuid)s]  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iscsi_iotype                   = fileio {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iscsi_target_flags             =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iscsi_write_cache              = on {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iser_helper                    = tgtadm {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iser_ip_address                = 192.168.122.100 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iser_port                      = 3260 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_color                      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_config_append              = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_dir                        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_file                       = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_options                    = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_rotate_interval            = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_rotate_interval_type       = days {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] log_rotation_type              = none {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] max_age                        = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] max_logfile_count              = 30 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] max_logfile_size_mb            = 200 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] max_over_subscription_ratio    = 20.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] message_reap_interval          = 86400 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] message_ttl                    = 2592000 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] migration_create_volume_timeout_secs = 300 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] monkey_patch                   = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] monkey_patch_modules           = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] my_ip                          = 192.168.122.100 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] no_snapshot_gb_quota           = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] num_iser_scan_tries            = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] num_shell_tries                = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] num_volume_device_scan_tries   = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] nvmeof_conn_info_version       = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] nvmet_ns_id                    = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[80056]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:28:29 devstack cinder-volume[80056]: INFO cinder.volume.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Starting volume driver QuobyteDriver (1.1.15)
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.remotefs [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=80056) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] nvmet_port_id                  = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_max_limit                = 1000 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_volume_ext_list          = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_volume_listen_port       = 8776 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_volume_use_ssl           = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] osapi_volume_workers           = 2 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] per_volume_size_limit          = -1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] periodic_fuzzy_delay           = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] periodic_interval              = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] public_endpoint                = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] publish_errors                 = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_backup_gigabytes         = 1000 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_backups                  = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_gigabytes                = 1000 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_groups                   = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_snapshots                = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] quota_volumes                  = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] rate_limit_burst               = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] rate_limit_except_level        = CRITICAL {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] rate_limit_interval            = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] reinit_driver_count            = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] replication_device             = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] report_discard_supported       = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] report_interval                = 120 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] reservation_clean_interval     = 86400 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] reservation_expire             = 86400 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] reserved_image_namespaces      = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] reserved_percentage            = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] rpc_response_timeout           = 120 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] run_external_periodic_tasks    = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] scst_target_driver             = iscsi {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] scst_target_iqn_name           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_down_time              = 720 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] shell_completion               = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] snapshot_name_template         = snapshot-%s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] split_loggers                  = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] state_path                     = /opt/stack/data/cinder {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] storage_availability_zone      = nova {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] storage_protocol               = iSCSI {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] syslog_log_facility            = LOG_USER {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] target_helper                  = lioadm {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] target_ip_address              = 192.168.122.100 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] target_port                    = 3260 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] target_protocol                = iscsi {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] target_secondary_ip_addresses  = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] trace_flags                    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] transport_url                  = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] until_refresh                  = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_chap_auth                  = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_default_quota_class        = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_journal                    = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_json                       = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_multipath_for_image_xfer   = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_stderr                     = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] use_syslog                     = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] verify_glance_signatures       = enabled {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_api_class               = cinder.volume.api.API {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_backend_name            = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_clear                   = zero {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_clear_ionice            = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_clear_size              = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_copy_bps_limit          = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_dd_blocksize            = 1M {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_name_template           = volume-%s {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_service_inithost_offload = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volume_usage_audit_period      = month {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] watch_log_file                 = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] zoning_mode                    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_concurrency.disable_process_locking = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.admin_password = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.admin_token = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.admin_user  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_admin_prefix =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_port   = 35357 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_protocol = https {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_section = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_type   = password {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_uri    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.auth_version = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.cache       = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.certfile    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.delay_auth_decision = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.http_connect_timeout = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.identity_uri = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.include_service_catalog = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.insecure    = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.interface   = public {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.keyfile     = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_password =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcache_username =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.region_name = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.service_token_roles_required = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.service_type = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.token_cache_time = 300 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] keystone_authtoken.www_authenticate_uri = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.backend                  = dogpile.cache.null {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.backend_argument         = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.backend_expiration_time  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.config_prefix            = cache.oslo {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.dead_timeout             = 60.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.debug_cache_backend      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.enable_retry_client      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.enable_socket_keepalive  = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.enabled                  = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.enforce_fips_mode        = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.expiration_time          = 600 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.hashclient_retry_attempts = 2 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_dead_retry      = 300 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_password        = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_pool_maxsize    = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_sasl_enabled    = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.memcache_username        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.proxies                  = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_db                 = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_password           = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_sentinel_service_name = mymaster {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_server             = localhost:6379 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_socket_timeout     = 1.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.redis_username           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.retry_attempts           = 2 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.retry_delay              = 0.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.socket_keepalive_count   = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.socket_keepalive_idle    = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.socket_keepalive_interval = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.tls_allowed_ciphers      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.tls_cafile               = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.tls_certfile             = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.tls_enabled              = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cache.tls_keyfile              = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] coordination.backend_url       = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.asyncio_connection    = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.asyncio_slave_connection = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.backend               = sqlalchemy {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.connection            = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.connection_debug      = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.connection_parameters =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.connection_recycle_time = 3600 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.connection_trace      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.db_inc_retry_interval = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.db_max_retries        = 20 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.db_max_retry_interval = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.db_retry_interval     = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.max_overflow          = 50 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.max_pool_size         = 5 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.max_retries           = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.mysql_wsrep_sync_wait = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.pool_timeout          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.retry_interval        = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.slave_connection      = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.sqlite_synchronous    = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] database.use_db_reconnect      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.connection_string     = messaging:// {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.enabled               = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.es_doc_type           = notification {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.es_scroll_size        = 10000 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.es_scroll_time        = 2m {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.filter_error_trace    = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.hmac_keys             = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.sentinel_service_name = mymaster {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.socket_timeout        = 0.1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.trace_requests        = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler.trace_sqlalchemy      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler_jaeger.process_tags   = {} {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler_jaeger.service_name_prefix = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] profiler_otlp.service_name_prefix = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.enforce_new_defaults = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: WARNING oslo_config.cfg [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.enforce_scope      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.policy_default_rule = default {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.policy_file        = policy.yaml {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.group          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.helper_command = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] privsep_osbrick.user           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.group         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.helper_command = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] cinder_sys_admin.user          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.auth_section      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.auth_type         = password {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.certfile          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.collect_timing    = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.insecure          = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.keyfile           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.send_service_user_token = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.split_loggers     = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] service_user.timeout           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.auth_section            = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.auth_type               = password {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.certfile                = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.collect_timing          = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.insecure                = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.keyfile                 = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.split_loggers           = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] glance.timeout                 = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.backend_availability_zone = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.chap_password = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.chap_username =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.driver_client_cert = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.driver_client_cert_key = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.driver_data_namespace = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.driver_use_ssl = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.enable_unsupported_driver = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.extra_capabilities = {} {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.filter_function = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.goodness_function = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iscsi_iotype  = fileio {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iscsi_target_flags =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iscsi_write_cache = on {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iser_helper   = tgtadm {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iser_port     = 3260 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_host      =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_login     = admin {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_mount_options = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_password  = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_private_key =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_share_path =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_ssh_port  = 22 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.num_shell_tries = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.nvmet_port_id = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_client_cfg = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.quobyte_volume_url = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.replication_device = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.report_discard_supported = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.reserved_percentage = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.scst_target_driver = iscsi {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.scst_target_iqn_name = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.storage_protocol = iSCSI {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.target_helper = tgtadm {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.target_port   = 3260 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.target_protocol = iscsi {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.trace_flags   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.unique_fqdn_network = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.use_chap_auth = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_backend_name = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_clear  = zero {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_clear_ionice = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_clear_size = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_reports.file_event_handler = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_reports.log_dir           = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.backend_availability_zone = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.backend_host         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.chap_password        = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.chap_username        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.chiscsi_conf         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.driver_client_cert   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.driver_client_cert_key = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.driver_data_namespace = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.driver_use_ssl       = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.extra_capabilities   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.filter_function      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.goodness_function    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iscsi_iotype         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iscsi_target_flags   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iscsi_write_cache    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iser_helper          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iser_ip_address      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iser_port            = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.iser_target_prefix   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_host             = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_login            = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_mount_options    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_password         = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_private_key      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_secure_file_operations = true {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_share_path       = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_ssh_port         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.num_shell_tries      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nvmet_ns_id          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.nvmet_port_id        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.replication_device   = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.report_discard_supported = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.reserved_percentage  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.scst_target_driver   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.storage_protocol     = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.target_helper        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.target_ip_address    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.target_port          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.target_prefix        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.target_protocol      = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.trace_flags          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.unique_fqdn_network  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.use_chap_auth        = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_clear         = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_clear_ionice  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_clear_size    = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] QuobyteHD.volumes_dir          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.ssl      = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_notifications.driver = [] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_notifications.retry = -1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] oslo_messaging_notifications.transport_url = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] key_manager.fixed_key          = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.barbican_api_version  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.barbican_endpoint     = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.barbican_endpoint_type = public {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.barbican_region_name  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.cafile                = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.certfile              = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.collect_timing        = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.insecure              = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.keyfile               = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.number_of_retries     = 60 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.retry_delay           = 1 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.send_service_user_token = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.split_loggers         = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.timeout               = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.verify_ssl            = True {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican.verify_ssl_path       = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.auth_section = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.auth_type = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.cafile   = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.certfile = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.collect_timing = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.insecure = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.keyfile  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.split_loggers = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] barbican_service_user.timeout  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.approle_role_id          = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.approle_secret_id        = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.kv_mountpoint            = secret {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.kv_path                  = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.kv_version               = 2 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.namespace                = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.root_token_id            = **** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.ssl_ca_crt_file          = None {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.timeout                  = 60.0 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.use_ssl                  = False {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:29 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] ******************************************************************************** {{(pid=79963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=80056) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:309}}
Sep 30 15:28:29 devstack cinder-volume[80056]: INFO cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Running cmd (subprocess): mount.quobyte {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:29 devstack quobyte-client[80058]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 15:28:29 devstack quobyte-client[80058]: Invalid parameters found, error: missing mount point.
Sep 30 15:28:29 devstack quobyte-client[80058]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 30 15:28:29 devstack quobyte-client[80058]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:28:29 devstack cinder-volume[80056]: INFO cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 ...
Sep 30 15:28:29 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 -c /etc/quobyte/client-cinder.cfg {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:29 devstack quobyte-client[80088]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 30 15:28:29 devstack quobyte-client[80088]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 15:28:29 devstack quobyte-client[80088]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152' to display the log.
Sep 30 15:28:29 devstack quobyte-client[80089]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 30 15:28:29 devstack quobyte-client[80089]: mount.quobyte 4.5 (2027c5892c)
Sep 30 15:28:29 devstack quobyte-client[80089]: Client UUID: TQq9fQe6-fZoC-EMxy-E49n-5Ix1EWqFDCmm
Sep 30 15:28:29 devstack quobyte-client[80089]: Registry: osci02.corp.quobyte.com:7861
Sep 30 15:28:29 devstack quobyte-client[80089]: Volume: cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:28:29 devstack quobyte-client[80089]: FUSE version: 316
Sep 30 15:28:29 devstack quobyte-client[80089]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 30 15:28:29 devstack quobyte-client[80089]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 30 15:28:29 devstack quobyte-client[80089]: Setting total object cache size to 5038407680 bytes
Sep 30 15:28:29 devstack quobyte-client[80089]: Using FUSE low-level API
Sep 30 15:28:29 devstack quobyte-client[80089]: Caching of uid/gid to user/group name mappings is enabled
Sep 30 15:28:29 devstack quobyte-client[80089]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 30 15:28:29 devstack quobyte-client[80089]: HTTP server started on port 55000
Sep 30 15:28:29 devstack quobyte-client[80089]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 30 15:28:29 devstack quobyte-client[80089]: Mount point /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 established
Sep 30 15:28:29 devstack quobyte-client[80089]: TimeSync is running and remote sync every 60 seconds
Sep 30 15:28:29 devstack quobyte-client[80089]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 15:28:29 devstack quobyte-client[80089]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 15:28:30 devstack quobyte-client[80089]: Opening volume cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 (6805ea78-c5bd-4ca1-bc25-61de153ac01d)
Sep 30 15:28:30 devstack quobyte-client[80089]: Setting metadata cache size to 1000000 based on available system memory of 23 GiB
Sep 30 15:28:30 devstack quobyte-client[80089]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 15:28:30 devstack quobyte-client[80089]: Changed metadata cache configuration for volume 6805ea78-c5bd-4ca1-bc25-61de153ac01d to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 30 15:28:30 devstack quobyte-client[80089]: Failed to invalidate inode: 38: Function not implemented
Sep 30 15:28:30 devstack quobyte-client[80089]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 15:28:30 devstack quobyte-client[80089]: Automatic minidump upload enabled by global system configuration
Sep 30 15:28:30 devstack quobyte-client[80089]: Announcing HTTP status server address 172.24.4.1
Sep 30 15:28:30 devstack quobyte-client[80089]: Registered as service (uuid TQq9fQe6-fZoC-EMxy-E49n-5Ix1EWqFDCmm)
Sep 30 15:28:30 devstack quobyte-client[80089]: Quobyte Client running as pid 80089
Sep 30 15:28:30 devstack quobyte-client[80089]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 30 15:28:30 devstack quobyte-client[80089]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] CMD "mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.373s {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 succeeded
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.386s {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:30 devstack quobyte-client[80089]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.volume.driver [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.volume.driver [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.15', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08403396606445, 'free_capacity_gb': 231.08403396606445, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80056) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_db.sqlalchemy.engines [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80056) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG dbcounter [-] [80056] Writer thread running {{(pid=80056) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.db.sqlalchemy.api [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Building query based on filter {{(pid=80056) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.image.image_utils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80056) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.keymgr.migration [None req-9d25fa13-43c5-4141-baf9-fa09f4a0a94c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.037s {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Notifying Schedulers of capabilities ... {{(pid=80056) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.volume.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Driver initialization completed successfully.
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Initiating service 3 cleanup
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Service 3 cleanup completed.
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.service [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Creating RPC server for service cinder-volume {{(pid=80056) start /opt/stack/cinder/cinder/service.py:239}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.service [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80056) start /opt/stack/cinder/cinder/service.py:245}}
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.volume.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.15)
Sep 30 15:28:30 devstack cinder-volume[80056]: WARNING cinder.volume.volume_utils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:28:30 devstack cinder-volume[80056]: WARNING cinder.volume.volume_utils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG cinder.volume.drivers.quobyte [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:30 devstack cinder-volume[80056]: DEBUG oslo_concurrency.processutils [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.035s {{(pid=80056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:30 devstack cinder-volume[80056]: INFO cinder.volume.manager [None req-58b240aa-e889-474e-b915-90fe4f89b6a4 None None] Driver post RPC initialization completed successfully.
Sep 30 15:28:31 devstack cinder-volume[79963]: INFO oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Caught SIGTERM, stopping children
Sep 30 15:28:31 devstack cinder-volume[79963]: DEBUG oslo_concurrency.lockutils [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Acquiring lock "singleton_lock" {{(pid=79963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:28:31 devstack cinder-volume[79963]: DEBUG oslo_concurrency.lockutils [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Acquired lock "singleton_lock" {{(pid=79963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:28:31 devstack cinder-volume[79963]: DEBUG oslo_concurrency.lockutils [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Releasing lock "singleton_lock" {{(pid=79963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:28:31 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Stop services. {{(pid=79963) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 30 15:28:31 devstack cinder-volume[79963]: DEBUG oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Killing children. {{(pid=79963) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 30 15:28:31 devstack cinder-volume[79963]: INFO oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Waiting on 1 children to exit
Sep 30 15:28:32 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Acquiring lock "singleton_lock" {{(pid=80056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:28:32 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Acquired lock "singleton_lock" {{(pid=80056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:28:32 devstack cinder-volume[80056]: DEBUG oslo_concurrency.lockutils [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Releasing lock "singleton_lock" {{(pid=80056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:28:32 devstack cinder-volume[80056]: WARNING amqp [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 15:28:32 devstack cinder-volume[80056]: WARNING amqp [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 15:28:32 devstack cinder-volume[79963]: INFO oslo_service.backend._eventlet.service [None req-ab458ff8-4191-43f6-b9f9-4819f053bebf None None] Child 80056 exited with status 0
Sep 30 15:28:32 devstack quobyte-client[80089]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 15:28:34 devstack cinder-volume[80277]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80277) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 15:28:34 devstack cinder-volume[80277]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80277) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 15:28:34 devstack cinder-volume[80277]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80277) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 15:28:34 devstack cinder-volume[80277]: INFO dbcounter [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Registered counter for database cinder
Sep 30 15:28:34 devstack cinder-volume[80277]: DEBUG oslo_db.sqlalchemy.engines [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:34 devstack cinder-volume[80277]: DEBUG dbcounter [-] [80277] Writer thread running {{(pid=80277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 15:28:34 devstack cinder-volume[80277]: INFO cinder.rpc [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 15:28:34 devstack cinder-volume[80277]: INFO cinder.rpc [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 15:28:34 devstack cinder-volume[80277]: DEBUG oslo_db.sqlalchemy.engines [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:35 devstack cinder-volume[80277]: INFO cinder.volume.manager [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Determined volume DB was empty at startup.
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG cinder.volume.manager [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80277) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 30 15:28:35 devstack cinder-volume[80277]: WARNING stevedore.named [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 15:28:35 devstack cinder-volume[80277]: WARNING castellan.key_manager [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:28:35 devstack cinder-volume[80277]: WARNING cinder.keymgr.conf_key_mgr [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 15:28:35 devstack cinder-volume[80277]: INFO cinder.volume.manager [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_db.sqlalchemy.engines [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:35 devstack cinder-volume[80277]: INFO oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Starting 1 workers
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Started child 80302 {{(pid=80277) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Full set of CONF: {{(pid=80277) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] ******************************************************************************** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Configuration options gathered from: {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] ================================================================================ {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] allow_availability_zone_fallback = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] allow_compression_on_image_upload = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] allowed_direct_url_schemes     = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] api_rate_limit                 = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] auth_strategy                  = keystone {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_availability_zone      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_host                   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_name                   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_stats_polling_interval = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backup_api_class               = cinder.backup.api.API {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backup_name_template           = backup-%s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backup_use_same_host           = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backup_use_temp_snapshot       = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] chap_password                  = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] chap_username                  =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_internal_tenant_project_id = df7733a9d7e149dfb8c3973f820cbc7d {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_internal_tenant_user_id = 4cfd70f3bdbd4df49ef487258c938f66 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cluster                        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] compression_format             = gzip {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] compute_api_class              = cinder.compute.nova.API {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] config_dir                     = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] config_source                  = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] control_exchange               = openstack {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] debug                          = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] default_availability_zone      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] default_group_type             = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] default_volume_type            = QuobyteHD {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] driver_client_cert             = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] driver_client_cert_key         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] driver_data_namespace          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] driver_ssl_cert_path           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] driver_ssl_cert_verify         = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] driver_use_ssl                 = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] enable_new_services            = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] enable_unsupported_driver      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] enabled_backends               = ['QuobyteHD'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] enforce_multipath_for_image_xfer = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] filter_function                = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_api_insecure            = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_api_servers             = ['http://192.168.122.100/image'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_api_ssl_compression     = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_ca_certificates_file    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_catalog_info            = image:glance:publicURL {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_certfile                = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_keyfile                 = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_num_retries             = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance_request_timeout         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] goodness_function              = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] graceful_shutdown_timeout      = 5 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] group_api_class                = cinder.group.api.API {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] host                           = devstack {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_compress_on_upload       = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_conversion_address_space_limit = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_conversion_cpu_limit     = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_conversion_disable       = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_upload_use_cinder_backend = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_upload_use_internal_tenant = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_volume_cache_enabled     = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_volume_cache_max_count   = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] image_volume_cache_max_size_gb = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] init_host_max_objects_retrieval = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] instance_format                = [instance: %(uuid)s]  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iscsi_iotype                   = fileio {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iscsi_target_flags             =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iscsi_write_cache              = on {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iser_helper                    = tgtadm {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iser_ip_address                = 192.168.122.100 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iser_port                      = 3260 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_color                      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_config_append              = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_dir                        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_file                       = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_options                    = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_rotate_interval            = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_rotate_interval_type       = days {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] log_rotation_type              = none {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] max_age                        = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] max_logfile_count              = 30 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] max_logfile_size_mb            = 200 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] max_over_subscription_ratio    = 20.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] message_reap_interval          = 86400 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] message_ttl                    = 2592000 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] migration_create_volume_timeout_secs = 300 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] monkey_patch                   = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] monkey_patch_modules           = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] my_ip                          = 192.168.122.100 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] no_snapshot_gb_quota           = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] num_iser_scan_tries            = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] num_shell_tries                = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] num_volume_device_scan_tries   = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] nvmeof_conn_info_version       = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] nvmet_ns_id                    = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] nvmet_port_id                  = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_max_limit                = 1000 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_volume_ext_list          = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_volume_listen_port       = 8776 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_volume_use_ssl           = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] osapi_volume_workers           = 2 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] per_volume_size_limit          = -1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] periodic_fuzzy_delay           = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] periodic_interval              = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] public_endpoint                = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] publish_errors                 = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_backup_gigabytes         = 1000 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_backups                  = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_gigabytes                = 1000 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_groups                   = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_snapshots                = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] quota_volumes                  = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] rate_limit_burst               = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] rate_limit_except_level        = CRITICAL {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] rate_limit_interval            = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] reinit_driver_count            = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] replication_device             = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] report_discard_supported       = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] report_interval                = 120 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] reservation_clean_interval     = 86400 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] reservation_expire             = 86400 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] reserved_image_namespaces      = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] reserved_percentage            = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] rpc_response_timeout           = 120 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] run_external_periodic_tasks    = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] scst_target_driver             = iscsi {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] scst_target_iqn_name           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_down_time              = 720 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] shell_completion               = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] snapshot_name_template         = snapshot-%s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] split_loggers                  = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] state_path                     = /opt/stack/data/cinder {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] storage_availability_zone      = nova {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] storage_protocol               = iSCSI {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] syslog_log_facility            = LOG_USER {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] target_helper                  = lioadm {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] target_ip_address              = 192.168.122.100 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] target_port                    = 3260 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] target_protocol                = iscsi {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] target_secondary_ip_addresses  = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] trace_flags                    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] transport_url                  = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] until_refresh                  = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_chap_auth                  = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_default_quota_class        = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_journal                    = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_json                       = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_multipath_for_image_xfer   = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_stderr                     = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] use_syslog                     = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] verify_glance_signatures       = enabled {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_api_class               = cinder.volume.api.API {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_backend_name            = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_clear                   = zero {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_clear_ionice            = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Starting volume driver QuobyteDriver (1.1.15)
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_clear_size              = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=80302) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_copy_bps_limit          = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_dd_blocksize            = 1M {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_name_template           = volume-%s {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_service_inithost_offload = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volume_usage_audit_period      = month {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] watch_log_file                 = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] zoning_mode                    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_concurrency.disable_process_locking = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.admin_password = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.admin_token = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.admin_user  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_port   = 35357 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_protocol = https {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_section = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_type   = password {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_uri    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.auth_version = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.cache       = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.certfile    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.delay_auth_decision = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.http_connect_timeout = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.identity_uri = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.include_service_catalog = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.insecure    = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.interface   = public {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.keyfile     = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_password =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcache_username =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.region_name = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.service_token_roles_required = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.service_type = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.token_cache_time = 300 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.backend                  = dogpile.cache.null {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.backend_argument         = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.backend_expiration_time  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.config_prefix            = cache.oslo {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.dead_timeout             = 60.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.debug_cache_backend      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.enable_retry_client      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.enable_socket_keepalive  = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.enabled                  = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.enforce_fips_mode        = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.expiration_time          = 600 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.hashclient_retry_attempts = 2 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_dead_retry      = 300 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_password        = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_pool_maxsize    = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_sasl_enabled    = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.memcache_username        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.proxies                  = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_db                 = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_password           = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_sentinel_service_name = mymaster {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_server             = localhost:6379 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_socket_timeout     = 1.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.redis_username           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.retry_attempts           = 2 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.retry_delay              = 0.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.socket_keepalive_count   = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.socket_keepalive_idle    = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.socket_keepalive_interval = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.tls_allowed_ciphers      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.tls_cafile               = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.tls_certfile             = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.tls_enabled              = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cache.tls_keyfile              = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] coordination.backend_url       = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.asyncio_connection    = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.asyncio_slave_connection = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.backend               = sqlalchemy {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.connection            = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.connection_debug      = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.connection_parameters =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.connection_recycle_time = 3600 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.connection_trace      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.db_inc_retry_interval = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.db_max_retries        = 20 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.db_max_retry_interval = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.db_retry_interval     = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.max_overflow          = 50 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.max_pool_size         = 5 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.max_retries           = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.mysql_wsrep_sync_wait = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.pool_timeout          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.retry_interval        = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.slave_connection      = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.sqlite_synchronous    = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] database.use_db_reconnect      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.connection_string     = messaging:// {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.enabled               = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.es_doc_type           = notification {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.es_scroll_size        = 10000 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.es_scroll_time        = 2m {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.filter_error_trace    = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.hmac_keys             = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.sentinel_service_name = mymaster {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.socket_timeout        = 0.1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.trace_requests        = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler.trace_sqlalchemy      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler_jaeger.process_tags   = {} {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler_jaeger.service_name_prefix = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] profiler_otlp.service_name_prefix = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.enforce_new_defaults = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: WARNING oslo_config.cfg [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.enforce_scope      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.policy_default_rule = default {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.policy_file        = policy.yaml {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.group          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.helper_command = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] privsep_osbrick.user           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.group         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.helper_command = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] cinder_sys_admin.user          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.auth_section      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.auth_type         = password {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.certfile          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.collect_timing    = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.insecure          = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.keyfile           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.send_service_user_token = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.split_loggers     = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] service_user.timeout           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.auth_section            = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.auth_type               = password {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.certfile                = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.collect_timing          = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.insecure                = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.keyfile                 = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.split_loggers           = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] glance.timeout                 = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.backend_availability_zone = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.chap_password = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.chap_username =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.driver_client_cert = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.driver_client_cert_key = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.driver_data_namespace = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.driver_use_ssl = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.enable_unsupported_driver = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.extra_capabilities = {} {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.filter_function = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.goodness_function = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iscsi_target_flags =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iscsi_write_cache = on {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iser_helper   = tgtadm {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iser_port     = 3260 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_host      =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_login     = admin {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_mount_options = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_password  = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_private_key =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_share_path =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.num_shell_tries = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.nvmet_port_id = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_client_cfg = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.quobyte_volume_url = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.replication_device = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.report_discard_supported = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.reserved_percentage = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.scst_target_driver = iscsi {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.scst_target_iqn_name = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.storage_protocol = iSCSI {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.target_helper = tgtadm {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.target_port   = 3260 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.target_protocol = iscsi {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=80302) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:309}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.trace_flags   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.unique_fqdn_network = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.use_chap_auth = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_backend_name = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_clear  = zero {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_clear_ionice = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_clear_size = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Running cmd (subprocess): mount.quobyte {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_reports.file_event_handler = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_reports.log_dir           = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.backend_availability_zone = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.backend_host         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.chap_password        = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.chap_username        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.chiscsi_conf         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.driver_client_cert   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.driver_client_cert_key = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.driver_data_namespace = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.driver_use_ssl       = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.extra_capabilities   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.filter_function      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.goodness_function    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iscsi_iotype         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iser_helper          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iser_ip_address      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iser_port            = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.iser_target_prefix   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_host             = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_login            = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_mount_options    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_password         = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_private_key      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_secure_file_operations = true {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_share_path       = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_ssh_port         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.num_shell_tries      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.nvmet_port_id        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.replication_device   = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.report_discard_supported = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.reserved_percentage  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.scst_target_driver   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.storage_protocol     = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.target_helper        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.target_ip_address    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.target_port          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.target_prefix        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.target_protocol      = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.trace_flags          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.use_chap_auth        = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_clear         = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_clear_size    = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] QuobyteHD.volumes_dir          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.ssl      = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_notifications.driver = [] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_notifications.retry = -1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] oslo_messaging_notifications.transport_url = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] key_manager.fixed_key          = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.barbican_api_version  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.barbican_endpoint     = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.barbican_endpoint_type = public {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.barbican_region_name  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.cafile                = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.certfile              = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.collect_timing        = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.insecure              = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.keyfile               = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.number_of_retries     = 60 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.retry_delay           = 1 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.send_service_user_token = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.split_loggers         = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.timeout               = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.verify_ssl            = True {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican.verify_ssl_path       = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.auth_section = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.auth_type = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.cafile   = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.certfile = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.collect_timing = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.insecure = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.keyfile  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.split_loggers = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] barbican_service_user.timeout  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.approle_role_id          = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.approle_secret_id        = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.kv_mountpoint            = secret {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.kv_path                  = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.kv_version               = 2 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.namespace                = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.root_token_id            = **** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.ssl_ca_crt_file          = None {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.timeout                  = 60.0 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.use_ssl                  = False {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 15:28:35 devstack cinder-volume[80277]: DEBUG oslo_service.backend._eventlet.service [None req-936bccdb-6c3b-419a-9b60-9d633fa90c8c None None] ******************************************************************************** {{(pid=80277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 30 15:28:35 devstack quobyte-client[80308]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 15:28:35 devstack quobyte-client[80308]: Invalid parameters found, error: missing mount point.
Sep 30 15:28:35 devstack quobyte-client[80308]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 30 15:28:35 devstack quobyte-client[80308]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.volume.driver [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.driver [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.15', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08403396606445, 'free_capacity_gb': 231.08403396606445, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80302) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_db.sqlalchemy.engines [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80302) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writer thread running {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.db.sqlalchemy.api [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Building query based on filter {{(pid=80302) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80302) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.keymgr.migration [None req-e0215655-939a-4de8-bd74-a02ad4711e8f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.015s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Driver initialization completed successfully.
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Initiating service 3 cleanup
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Service 3 cleanup completed.
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.service [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Creating RPC server for service cinder-volume {{(pid=80302) start /opt/stack/cinder/cinder/service.py:239}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.service [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80302) start /opt/stack/cinder/cinder/service.py:245}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.15)
Sep 30 15:28:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:28:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:28:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.015s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:28:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-610a68d0-e76d-4c3d-8e74-871e1cea7694 None None] Driver post RPC initialization completed successfully.
Sep 30 15:28:45 devstack cinder-volume[80277]: DEBUG dbcounter [-] [80277] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=80277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:28:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:28:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.015s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:29:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:17 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Flow 'volume_create_manager' (bd2a52aa-2be8-4c5f-a7bd-7b92fb03c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3e3bf3-abda-4e7c-842b-2b8887d75650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3e3bf3-abda-4e7c-842b-2b8887d75650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1559893927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2cb1f76327644f6b40ec390aca83044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:17Z,use_quota=True,user_id='44f926c5055e41a69040bdc43b685ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddb4141-e8e6-4aa7-93c6-494d8f2e956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddb4141-e8e6-4aa7-93c6-494d8f2e956e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370835c8-0e41-407f-94ec-8a700bc72166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370835c8-0e41-407f-94ec-8a700bc72166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b', 'volume_name': 'volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec610a9-4820-40d1-ac70-c8d2a7606673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec610a9-4820-40d1-ac70-c8d2a7606673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36a06c0-9318-418f-853f-f27c1e1784dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:17 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume 7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b', 'volume_size': 1}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1559893927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2cb1f76327644f6b40ec390aca83044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:17Z,use_quota=True,user_id='44f926c5055e41a69040bdc43b685ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Creating volume 7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:17 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:17 devstack quobyte-client[80089]: System call "create" of process 80770 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:17 devstack quobyte-client[80089]: System call "getattr" of process 80770 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:17 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=2, name=volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b 1073741824" returned: 0 in 0.175s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] <== create_volume: return (213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.216s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36a06c0-9318-418f-853f-f27c1e1784dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694c050-9c9a-40a7-8caf-7bc48dc88749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:17 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b (7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b): created successfully
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694c050-9c9a-40a7-8caf-7bc48dc88749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Flow 'volume_create_manager' (bd2a52aa-2be8-4c5f-a7bd-7b92fb03c523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-d7e501eb-6ba2-4ac5-ad18-590cbec35f67 req-157f1e25-74c4-4aa9-955f-c84e32435b44 tempest-VolumesSnapshotsTestJSON-1603129485 None] Created volume successfully.
Sep 30 15:30:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Creating offline snapshot 9e279b3a-884c-4959-b22b-c7926e537633 of volume 7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:30:18 devstack cinder-volume[80302]: INFO oslo.privsep.daemon [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzk2n479l/privsep.sock']
Sep 30 15:30:18 devstack sudo[81089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzk2n479l/privsep.sock
Sep 30 15:30:18 devstack sudo[81089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:30:19 devstack sudo[81089]: pam_unix(sudo:session): session closed for user root
Sep 30 15:30:19 devstack cinder-volume[80302]: INFO oslo.privsep.daemon [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Spawned new privsep daemon via rootwrap
Sep 30 15:30:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Accepted privsep connection to /tmp/tmpzk2n479l/privsep.sock {{(pid=80302) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 30 15:30:19 devstack cinder-volume[80302]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 30 15:30:19 devstack cinder-volume[80302]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 30 15:30:19 devstack cinder-volume[80302]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 30 15:30:19 devstack cinder-volume[80302]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81092
Sep 30 15:30:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[46046805-f1ba-4e89-882e-2bcc54de7370]: (2,) {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[259606ce-9af1-4512-81f2-58f427cea84e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" returned: 0 in 0.153s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:20 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=3, name=volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 1G" returned: 0 in 0.107s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:20 devstack quobyte-client[80089]: System call "open" of process 81100 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "qemu-img rebase -u -b volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633" returned: 0 in 0.079s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.info" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.info" returned: 0 in 0.065s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.757s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-ea7231d3-2920-43a8-addd-807c04f6c0c6 req-f67d972d-750d-4068-9173-5604b7223e98 tempest-VolumesSnapshotsTestJSON-1603129485 None] Create snapshot completed successfully
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "cinder-9e279b3a-884c-4959-b22b-c7926e537633-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-9e279b3a-884c-4959-b22b-c7926e537633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "cinder-quobyte-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-quobyte-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "cinder-quobyte-9e279b3a-884c-4959-b22b-c7926e537633" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-quobyte-9e279b3a-884c-4959-b22b-c7926e537633" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Deleting offline snapshot 9e279b3a-884c-4959-b22b-c7926e537633 of volume 7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] snapshot_file for this snap is: volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[040163c1-b00f-4fc0-91a6-74ea9384d607]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e0a9a-aa5e-41d1-87ce-6edca7b696d5]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:21 devstack quobyte-client[80089]: System call "lookup" of process 81113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:21 devstack quobyte-client[80089]: System call "getattr" of process 81113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:21 devstack quobyte-client[80089]: System call "open" of process 81113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633" returned: 0 in 0.084s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b.9e279b3a-884c-4959-b22b-c7926e537633" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-quobyte-9e279b3a-884c-4959-b22b-c7926e537633" released by "_delete_snapshot" :: held 0.463s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-quobyte-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" released by "delete_snapshot" :: held 0.475s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:21 devstack cinder-volume[80302]: WARNING cinder.quota [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:30:21 devstack cinder-volume[80302]: WARNING cinder.quota [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG cinder.quota [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Created reservations ['3fb11add-0226-4cc0-af2c-b3c4a7da90ef', 'e6052d8f-635e-44dc-bfb0-3e6271565206', 'a513fa10-42fb-4a64-b02a-20b75f345deb', '8e2aadda-de9f-4498-ad2e-c8bd6fa44d94'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Delete snapshot completed successfully.
Sep 30 15:30:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-ffc5d84a-2868-4315-9dde-78bccda385b5 req-3593181e-c68f-4711-a641-aa643dbb2b05 tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-9e279b3a-884c-4959-b22b-c7926e537633-delete_snapshot" released by "delete_snapshot" :: held 0.601s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "cinder-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "cinder-quobyte-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-quobyte-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf0a80-35da-4a1e-a7b8-a9649bf8c797]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" returned: 0 in 0.159s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" returned: 0 in 0.041s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-quobyte-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b" released by "delete_volume" :: held 0.242s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:22 devstack cinder-volume[80302]: WARNING cinder.quota [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.quota [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Created reservations ['5d42461e-2026-4b15-8687-98a06ef26fa3', 'cba2f52a-684b-42d1-a16a-a95740d410d1', '130529f3-13e2-4ff4-94e9-18ee430d50cf', '371b80b1-18ee-47f7-a7de-494c615a3e56'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.manager [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Deleted volume successfully.
Sep 30 15:30:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-3f40b8cc-4b38-466b-9a4f-3382d9a0543d req-3ee0d56f-ecc8-439a-a49c-d972607aa66a tempest-VolumesSnapshotsTestJSON-1603129485 None] Lock "cinder-7f1b38c7-a6b7-408e-9d3d-ae429c2cb02b-delete_volume" released by "delete_volume" :: held 0.433s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Flow 'volume_create_manager' (b3587987-c998-4de7-b202-d268db983f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4200140-8b01-4649-89cb-8f12ba903eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4200140-8b01-4649-89cb-8f12ba903eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-968442581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc102550-4c79-442e-ae38-377670505911,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bc556026d7d4351818f1954d299ce62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:28Z,use_quota=True,user_id='8c80d3315a3f4350a15da6a2faa799a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd34a56-95b1-451d-99fe-2b59895f8e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd34a56-95b1-451d-99fe-2b59895f8e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e8ad76-9f1a-4945-8d8d-8e38b1f5d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e8ad76-9f1a-4945-8d8d-8e38b1f5d81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc102550-4c79-442e-ae38-377670505911', 'volume_name': 'volume-fc102550-4c79-442e-ae38-377670505911', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b034b7-8734-405f-ba26-cccbf40fd11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b034b7-8734-405f-ba26-cccbf40fd11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f8c54a-954a-43bf-8251-4ba14a2a25a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Volume fc102550-4c79-442e-ae38-377670505911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc102550-4c79-442e-ae38-377670505911', 'volume_size': 1}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-968442581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc102550-4c79-442e-ae38-377670505911,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bc556026d7d4351818f1954d299ce62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:28Z,use_quota=True,user_id='8c80d3315a3f4350a15da6a2faa799a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Creating volume fc102550-4c79-442e-ae38-377670505911 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:27 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:27 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=5, name=volume-fc102550-4c79-442e-ae38-377670505911, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911 1073741824" returned: 0 in 0.173s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] <== create_volume: return (201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.204s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f8c54a-954a-43bf-8251-4ba14a2a25a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc102550-4c79-442e-ae38-377670505911', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c5dd47-09df-42c4-ab78-6d913ab5ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:28 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Volume volume-fc102550-4c79-442e-ae38-377670505911 (fc102550-4c79-442e-ae38-377670505911): created successfully
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c5dd47-09df-42c4-ab78-6d913ab5ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Flow 'volume_create_manager' (b3587987-c998-4de7-b202-d268db983f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-201fc8ce-b2e9-4221-b15b-fc9d1d098937 req-9a081cfd-2f57-45a4-a4bf-dbda675f2a4d tempest-VolumesGetTestJSON-2144952257 None] Created volume successfully.
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Acquiring lock "cinder-fc102550-4c79-442e-ae38-377670505911-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Lock "cinder-fc102550-4c79-442e-ae38-377670505911-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Acquiring lock "cinder-quobyte-fc102550-4c79-442e-ae38-377670505911" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Lock "cinder-quobyte-fc102550-4c79-442e-ae38-377670505911" acquired by "delete_volume" :: waited 0.016s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279a04d-fac8-42fb-b1e5-fccebe7da4e6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911" returned: 0 in 0.174s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fc102550-4c79-442e-ae38-377670505911" returned: 0 in 0.043s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Lock "cinder-quobyte-fc102550-4c79-442e-ae38-377670505911" released by "delete_volume" :: held 0.250s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.quota [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Created reservations ['500c399d-b979-4f1e-a827-c91081bf6f21', 'd2e2a3e7-fa34-4164-b9db-39c3896b08e4', '8c0508b1-95cf-418c-b9f2-ae7264629d23', '2872ca69-1be0-46dd-9095-2a43fafc38d3'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.manager [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Deleted volume successfully.
Sep 30 15:30:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-11a04a59-b084-4f82-a84b-06aa340ac6e7 req-3f47c8be-a9a6-47f3-b8dc-facc0dfc2e7e tempest-VolumesGetTestJSON-2144952257 None] Lock "cinder-fc102550-4c79-442e-ae38-377670505911-delete_volume" released by "delete_volume" :: held 0.474s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:30:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:39 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=4 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:30:42 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Flow 'volume_create_manager' (09b59a94-864c-442b-a0b3-7bff081d2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0df10-5f1b-43c4-8f00-72b814685337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0df10-5f1b-43c4-8f00-72b814685337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1312447721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ec3400-da6e-4f84-afc6-6853ce7ea400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f19fd578ee1484baa163e4cc79f850c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:43Z,use_quota=True,user_id='0e0b651b7939412592ed026143741e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce7ed9f-503a-4fed-af7f-a03176a32bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce7ed9f-503a-4fed-af7f-a03176a32bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cf45ca-74a6-4ed1-b621-76e733041de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cf45ca-74a6-4ed1-b621-76e733041de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ec3400-da6e-4f84-afc6-6853ce7ea400', 'volume_name': 'volume-37ec3400-da6e-4f84-afc6-6853ce7ea400', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd084b3-3530-406b-8a4a-e2cda8e7d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd084b3-3530-406b-8a4a-e2cda8e7d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adae49f-a17e-48a7-82f0-c493f12ca797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:42 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume 37ec3400-da6e-4f84-afc6-6853ce7ea400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ec3400-da6e-4f84-afc6-6853ce7ea400', 'volume_size': 1}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1312447721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ec3400-da6e-4f84-afc6-6853ce7ea400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f19fd578ee1484baa163e4cc79f850c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:43Z,use_quota=True,user_id='0e0b651b7939412592ed026143741e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Creating volume 37ec3400-da6e-4f84-afc6-6853ce7ea400 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:42 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:42 devstack quobyte-client[80089]: System call "getlk" of process 81227 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:42 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=6, name=volume-37ec3400-da6e-4f84-afc6-6853ce7ea400, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 1073741824" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] <== create_volume: return (188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.191s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adae49f-a17e-48a7-82f0-c493f12ca797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ec3400-da6e-4f84-afc6-6853ce7ea400', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7366698c-ab6a-4b32-937e-05622b7974d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 (37ec3400-da6e-4f84-afc6-6853ce7ea400): created successfully
Sep 30 15:30:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7366698c-ab6a-4b32-937e-05622b7974d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Flow 'volume_create_manager' (09b59a94-864c-442b-a0b3-7bff081d2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:43 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-23df01bf-e81f-4b7d-9eee-04419cc00b57 tempest-VolumesAssistedSnapshotsTest-976842791 None] Created volume successfully.
Sep 30 15:30:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:30:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:49 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Flow 'volume_create_manager' (d682b5b2-97ac-426f-9fce-777ccf41cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40ef1eb-b2dd-4bb3-8668-1b4597ec6539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40ef1eb-b2dd-4bb3-8668-1b4597ec6539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1882463711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60491c2d-fbd6-4187-9d36-7ea60bf9e900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fff245682784362b6e4c3c9f639d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:50Z,use_quota=True,user_id='090fb2e1a23e488ab86d2161125cff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956c22cc-73b7-4866-a157-992df81a9d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956c22cc-73b7-4866-a157-992df81a9d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889c8c94-811d-492d-9ff8-b4e0618f11a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889c8c94-811d-492d-9ff8-b4e0618f11a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60491c2d-fbd6-4187-9d36-7ea60bf9e900', 'volume_name': 'volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dc5170-60e6-4399-87f6-bc30a3b5897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dc5170-60e6-4399-87f6-bc30a3b5897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633dae80-9e6b-45ac-9835-76fd4e8566d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:50 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Volume 60491c2d-fbd6-4187-9d36-7ea60bf9e900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900', 'volume_size': 1}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1882463711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60491c2d-fbd6-4187-9d36-7ea60bf9e900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fff245682784362b6e4c3c9f639d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:50Z,use_quota=True,user_id='090fb2e1a23e488ab86d2161125cff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Creating volume 60491c2d-fbd6-4187-9d36-7ea60bf9e900 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:50 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:50 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=7, name=volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900 1073741824" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.182s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633dae80-9e6b-45ac-9835-76fd4e8566d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6704b46f-5f4d-4f2b-87a6-74ba32cc7e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:50 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Volume volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900 (60491c2d-fbd6-4187-9d36-7ea60bf9e900): created successfully
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6704b46f-5f4d-4f2b-87a6-74ba32cc7e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Flow 'volume_create_manager' (d682b5b2-97ac-426f-9fce-777ccf41cc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7cdcf024-bd26-46fa-8fa2-f32fd2f10e9d tempest-VolumesListAdminTestJSON-1427266825 None] Created volume successfully.
Sep 30 15:30:51 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Flow 'volume_create_manager' (390579a1-dfbc-4f4b-a762-c7982170299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f00e0b6-24f2-485f-8fc6-e197308a0f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f00e0b6-24f2-485f-8fc6-e197308a0f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-280673041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eff6b7-2bf9-4d44-a27e-e4c2a572b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fff245682784362b6e4c3c9f639d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:51Z,use_quota=True,user_id='090fb2e1a23e488ab86d2161125cff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cbe33f-6868-431b-88dd-27a9ada555bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cbe33f-6868-431b-88dd-27a9ada555bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d619401-88a3-4969-bec4-f86a46f6b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d619401-88a3-4969-bec4-f86a46f6b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07eff6b7-2bf9-4d44-a27e-e4c2a572b628', 'volume_name': 'volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3b0f05-cbd3-4bd7-80c6-ac7d73fbe1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3b0f05-cbd3-4bd7-80c6-ac7d73fbe1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e396b3c-8705-4580-87ec-e8a35946b5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:51 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Volume 07eff6b7-2bf9-4d44-a27e-e4c2a572b628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628', 'volume_size': 1}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-280673041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eff6b7-2bf9-4d44-a27e-e4c2a572b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fff245682784362b6e4c3c9f639d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:51Z,use_quota=True,user_id='090fb2e1a23e488ab86d2161125cff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Creating volume 07eff6b7-2bf9-4d44-a27e-e4c2a572b628 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:51 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:51 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=8, name=volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628 1073741824" returned: 0 in 0.232s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] <== create_volume: return (270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.275s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e396b3c-8705-4580-87ec-e8a35946b5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd197c07-0ea7-43d7-98c2-db8bb8bcc7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:51 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Volume volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628 (07eff6b7-2bf9-4d44-a27e-e4c2a572b628): created successfully
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd197c07-0ea7-43d7-98c2-db8bb8bcc7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:51 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Flow 'volume_create_manager' (390579a1-dfbc-4f4b-a762-c7982170299e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-efba22da-639a-47cc-8a4d-911053cf914e tempest-VolumesListAdminTestJSON-1427266825 None] Created volume successfully.
Sep 30 15:30:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:30:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Flow 'volume_create_manager' (a432b1e1-b5ef-4a37-bb0a-c72766892c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db5c97d-5217-4ed6-9a54-9b41af8a1c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db5c97d-5217-4ed6-9a54-9b41af8a1c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-564243185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533ff617-1263-4e83-a05c-d77b72b5b7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fff245682784362b6e4c3c9f639d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:53Z,use_quota=True,user_id='090fb2e1a23e488ab86d2161125cff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f21407-3091-422a-a657-7def53336039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f21407-3091-422a-a657-7def53336039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55084713-4183-4f05-a590-84a94a497bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55084713-4183-4f05-a590-84a94a497bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533ff617-1263-4e83-a05c-d77b72b5b7f5', 'volume_name': 'volume-533ff617-1263-4e83-a05c-d77b72b5b7f5', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebce333-210a-40bf-b3d2-6f077786b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebce333-210a-40bf-b3d2-6f077786b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace45a5d-f122-47ad-9661-a713692f60fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:52 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Volume 533ff617-1263-4e83-a05c-d77b72b5b7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533ff617-1263-4e83-a05c-d77b72b5b7f5', 'volume_size': 1}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-564243185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533ff617-1263-4e83-a05c-d77b72b5b7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fff245682784362b6e4c3c9f639d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:53Z,use_quota=True,user_id='090fb2e1a23e488ab86d2161125cff20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Creating volume 533ff617-1263-4e83-a05c-d77b72b5b7f5 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:52 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:53 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=9, name=volume-533ff617-1263-4e83-a05c-d77b72b5b7f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5 1073741824" returned: 0 in 0.120s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] <== create_volume: return (158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.160s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace45a5d-f122-47ad-9661-a713692f60fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533ff617-1263-4e83-a05c-d77b72b5b7f5', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51547b3-c73a-4adb-9436-412a0a788868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:53 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Volume volume-533ff617-1263-4e83-a05c-d77b72b5b7f5 (533ff617-1263-4e83-a05c-d77b72b5b7f5): created successfully
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51547b3-c73a-4adb-9436-412a0a788868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Flow 'volume_create_manager' (a432b1e1-b5ef-4a37-bb0a-c72766892c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:53 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-da973b80-90ef-4d4f-83a7-4cabb12aaa85 tempest-VolumesListAdminTestJSON-1427266825 None] Created volume successfully.
Sep 30 15:30:54 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Flow 'volume_create_manager' (5c54426e-37eb-4369-a437-d4317128e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5069df41-91d1-4fee-9787-1bb0bb516681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5069df41-91d1-4fee-9787-1bb0bb516681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9231a7c-b51f-4ff4-9f77-7621d636bfb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de620afc4d0c47198fcec04aef0b6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:54Z,use_quota=True,user_id='130d914ca05348b9b6ce64bc70814614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc03b3-1a38-455c-87e5-c2fa69960b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc03b3-1a38-455c-87e5-c2fa69960b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f078123-a3d0-418d-a942-b5e0ecdd91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f078123-a3d0-418d-a942-b5e0ecdd91a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9231a7c-b51f-4ff4-9f77-7621d636bfb1', 'volume_name': 'volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c55022-7afb-4530-8164-7919c4051d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c55022-7afb-4530-8164-7919c4051d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842d6007-99f7-4cba-8850-e767834c2632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:54 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Volume e9231a7c-b51f-4ff4-9f77-7621d636bfb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1', 'volume_size': 1}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9231a7c-b51f-4ff4-9f77-7621d636bfb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de620afc4d0c47198fcec04aef0b6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:54Z,use_quota=True,user_id='130d914ca05348b9b6ce64bc70814614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Creating volume e9231a7c-b51f-4ff4-9f77-7621d636bfb1 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:54 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:54 devstack quobyte-client[80089]: System call "open" of process 81433 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:54 devstack quobyte-client[80089]: System call "ioctl" of process 81433 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:54 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=10, name=volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1 1073741824" returned: 0 in 0.112s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] <== create_volume: return (138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.141s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842d6007-99f7-4cba-8850-e767834c2632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266491e0-53cc-4da0-8baa-9086dc894705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:54 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Volume volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1 (e9231a7c-b51f-4ff4-9f77-7621d636bfb1): created successfully
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266491e0-53cc-4da0-8baa-9086dc894705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Flow 'volume_create_manager' (5c54426e-37eb-4369-a437-d4317128e523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:54 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6c9439f8-606f-4f40-9357-158580541f98 tempest-VolumesListAdminTestJSON-1397082501 None] Created volume successfully.
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Acquiring lock "cinder-e9231a7c-b51f-4ff4-9f77-7621d636bfb1-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "cinder-e9231a7c-b51f-4ff4-9f77-7621d636bfb1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:55 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Acquiring lock "cinder-quobyte-e9231a7c-b51f-4ff4-9f77-7621d636bfb1" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "cinder-quobyte-e9231a7c-b51f-4ff4-9f77-7621d636bfb1" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[118597e5-6156-457a-8e93-352e1b3e8d93]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "cinder-533ff617-1263-4e83-a05c-d77b72b5b7f5-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-533ff617-1263-4e83-a05c-d77b72b5b7f5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:55 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "cinder-quobyte-533ff617-1263-4e83-a05c-d77b72b5b7f5" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-quobyte-533ff617-1263-4e83-a05c-d77b72b5b7f5" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[25294356-f54a-48ed-8b00-9385649b3e7b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1" returned: 0 in 0.170s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9231a7c-b51f-4ff4-9f77-7621d636bfb1" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "cinder-quobyte-e9231a7c-b51f-4ff4-9f77-7621d636bfb1" released by "delete_volume" :: held 0.234s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Created reservations ['2f4f6d8a-e830-4730-986e-7ab4ff3ffc44', '135c0a69-2ad9-40e0-af79-71295b82b4ea', '99815a90-c094-43f3-9fce-d91031e2ae9e', 'd485d0e0-537f-4003-9435-bedee540adfd'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:55 devstack quobyte-client[80089]: System call "open" of process 81443 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5" returned: 0 in 0.294s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.070s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:55 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:55 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Deleted volume successfully.
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-533ff617-1263-4e83-a05c-d77b72b5b7f5" returned: 0 in 0.068s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-quobyte-533ff617-1263-4e83-a05c-d77b72b5b7f5" released by "delete_volume" :: held 0.413s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4d4dae10-bb88-461d-8d1a-3cb49a15d590 tempest-VolumesListAdminTestJSON-1397082501 None] Lock "cinder-e9231a7c-b51f-4ff4-9f77-7621d636bfb1-delete_volume" released by "delete_volume" :: held 0.567s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Created reservations ['4a946699-f605-4ad0-9e5f-9da16e98899b', 'f2b3d58e-d5f8-4f73-b8e1-d3c47eb91083', '1c6d4bd2-12de-4f5f-9e29-e1d97ce1a641', '260b7635-2f75-4ef1-afe4-888493e4ec47'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:56 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Deleted volume successfully.
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-68a8123c-85c0-4211-b569-bb5b9a43f215 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-533ff617-1263-4e83-a05c-d77b72b5b7f5-delete_volume" released by "delete_volume" :: held 0.626s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "cinder-07eff6b7-2bf9-4d44-a27e-e4c2a572b628-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-07eff6b7-2bf9-4d44-a27e-e4c2a572b628-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:56 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "cinder-quobyte-07eff6b7-2bf9-4d44-a27e-e4c2a572b628" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-quobyte-07eff6b7-2bf9-4d44-a27e-e4c2a572b628" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a540a4-74a9-43ed-9a6c-6351f4906b9b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:56 devstack quobyte-client[80089]: System call "getattr" of process 81453 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628" returned: 0 in 0.149s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-07eff6b7-2bf9-4d44-a27e-e4c2a572b628" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-quobyte-07eff6b7-2bf9-4d44-a27e-e4c2a572b628" released by "delete_volume" :: held 0.202s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Created reservations ['7ca77505-f12c-4d85-9abe-823175703d71', '1ca5d415-1977-42e7-8170-601ba321dd95', 'b72c759c-ab07-4e97-9191-230f78193372', 'bc884cd2-441d-478f-acae-a6a8a56abacd'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:57 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Deleted volume successfully.
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-163968eb-da85-46b9-acbe-c321cc3841f7 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-07eff6b7-2bf9-4d44-a27e-e4c2a572b628-delete_volume" released by "delete_volume" :: held 0.383s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:57 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Flow 'volume_create_manager' (be27395b-aed9-4148-b4ef-a24be5498c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ae93fa-4462-4be9-aaba-83fcbb138073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ae93fa-4462-4be9-aaba-83fcbb138073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1455268012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bb47e3-4fd1-422d-b9b2-7af07ca02d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9160fde184a3f9b33233bcc448910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:58Z,use_quota=True,user_id='b374e0409003468e996b8f3e5c62b1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8cc4c5-7100-452a-b6c9-6555ef8b81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8cc4c5-7100-452a-b6c9-6555ef8b81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0c138b-8a43-4cbf-a362-a0276ad94eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0c138b-8a43-4cbf-a362-a0276ad94eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bb47e3-4fd1-422d-b9b2-7af07ca02d05', 'volume_name': 'volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c044ddb-61eb-4f5d-81a9-925eee60729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c044ddb-61eb-4f5d-81a9-925eee60729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6833007-5329-483b-92ff-a61b7bd077b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:57 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Volume 05bb47e3-4fd1-422d-b9b2-7af07ca02d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05', 'volume_size': 1}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1455268012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bb47e3-4fd1-422d-b9b2-7af07ca02d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9160fde184a3f9b33233bcc448910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:30:58Z,use_quota=True,user_id='b374e0409003468e996b8f3e5c62b1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Creating volume 05bb47e3-4fd1-422d-b9b2-7af07ca02d05 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:30:57 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:57 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=11, name=volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "cinder-60491c2d-fbd6-4187-9d36-7ea60bf9e900-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:57 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-60491c2d-fbd6-4187-9d36-7ea60bf9e900-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 1073741824" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "cinder-quobyte-60491c2d-fbd6-4187-9d36-7ea60bf9e900" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-quobyte-60491c2d-fbd6-4187-9d36-7ea60bf9e900" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315e847-7573-4bd0-b05b-ce2309a06d50]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" returned: 0 in 0.054s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] <== create_volume: return (208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.211s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6833007-5329-483b-92ff-a61b7bd077b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229f32f5-3e48-4c3e-822e-9906fc336c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:30:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Volume volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 (05bb47e3-4fd1-422d-b9b2-7af07ca02d05): created successfully
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229f32f5-3e48-4c3e-822e-9906fc336c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Flow 'volume_create_manager' (be27395b-aed9-4148-b4ef-a24be5498c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:30:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-489133ac-5b3d-44a8-8702-abbd7cbf615c tempest-DeleteServersTestJSON-593869180 None] Created volume successfully.
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900" returned: 0 in 0.171s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-60491c2d-fbd6-4187-9d36-7ea60bf9e900" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-quobyte-60491c2d-fbd6-4187-9d36-7ea60bf9e900" released by "delete_volume" :: held 0.236s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Created reservations ['57764619-c4d3-497e-b504-7c320fcc0b30', '24381478-5bc3-4759-98ba-4fa9613caeb1', 'f4d49777-072c-4170-bc52-e50a98f6ed9f', 'a8d2cdaf-1fd7-46b2-9d54-f9443dd77de0'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:30:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Deleted volume successfully.
Sep 30 15:30:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6478dc40-a94d-49e5-8d19-26e18b525151 tempest-VolumesListAdminTestJSON-1427266825 None] Lock "cinder-60491c2d-fbd6-4187-9d36-7ea60bf9e900-delete_volume" released by "delete_volume" :: held 0.441s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:30:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[594bdf53-ce5a-4e89-a8b5-265c4deb14c2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" returned: 0 in 0.229s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.258s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba43693f-dc5a-4e00-90fa-309eb2b48a2e', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:31:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-6cff750c-c022-4094-8340-37d5c1e2b0ee req-cbce1c69-2bf3-4d6c-a602-c7478246fd4e tempest-DeleteServersTestJSON-593869180 None] attachment_update completed successfully.
Sep 30 15:31:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:07 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Flow 'volume_create_manager' (cd65e056-1634-4b98-a633-119c576d919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9901abcd-b348-4cf5-bfe4-146dfe67387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9901abcd-b348-4cf5-bfe4-146dfe67387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2036687396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8b3775-8123-4e4a-9de2-ecd2429b3110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc6b12afd39444685c5bc77eb8643fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:08Z,use_quota=True,user_id='ece9b176aba94907bdd7f5bd651d83a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd23fcf6-6940-4b71-b0a4-daad549ceb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd23fcf6-6940-4b71-b0a4-daad549ceb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1158ac10-7a6e-40b2-bec6-405f79cd1cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:07 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1158ac10-7a6e-40b2-bec6-405f79cd1cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f8b3775-8123-4e4a-9de2-ecd2429b3110', 'volume_name': 'volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423898940>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96c92c3-2515-4db9-9ef6-8727ac9cebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96c92c3-2515-4db9-9ef6-8727ac9cebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0016c1-796f-4920-9ac2-848f5f7d7820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:08 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Volume 7f8b3775-8123-4e4a-9de2-ecd2429b3110: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423898940>}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Cloning 7f8b3775-8123-4e4a-9de2-ecd2429b3110 from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31  at location (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:31:08 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cddcbc-f604-4bd9-8ff3-594d58a3efb0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:08 devstack sudo[82010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD
Sep 30 15:31:08 devstack sudo[82010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:08 devstack sudo[82010]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 is fetched for user ece9b176aba94907bdd7f5bd651d83a8. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2fa7ed-2847-49ef-8828-dcca8fc66aad]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:09 devstack sudo[82015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD
Sep 30 15:31:09 devstack sudo[82015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:09 devstack sudo[82015]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2036687396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8b3775-8123-4e4a-9de2-ecd2429b3110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc6b12afd39444685c5bc77eb8643fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:08Z,use_quota=True,user_id='ece9b176aba94907bdd7f5bd651d83a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Creating volume 7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:09 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:09 devstack quobyte-client[80089]: System call "lookup" of process 82020 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:09 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=12, name=volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 1073741824" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] <== create_volume: return (185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.187s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Attempting download of 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume 7f8b3775-8123-4e4a-9de2-ecd2429b3110. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6feb69-4f11-4358-9168-f3429267f92c]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:09 devstack sudo[82024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn
Sep 30 15:31:09 devstack sudo[82024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:10 devstack sudo[82024]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn" returned: 0 in 0.549s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:10 devstack sudo[82028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn
Sep 30 15:31:10 devstack sudo[82028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:10 devstack sudo[82028]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn" returned: 1 in 0.684s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_6d5fi5qn' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:31:10 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f17258-b6d8-42df-8e69-104d87273f50]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:11 devstack sudo[82032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD
Sep 30 15:31:11 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:11 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:11 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 was qcow2, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:31:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:11 devstack sudo[82037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110
Sep 30 15:31:11 devstack sudo[82037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:12 devstack quobyte-client[80089]: System call "lookup" of process 82060 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:12 devstack quobyte-client[80089]: System call "getattr" of process 82060 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:12 devstack quobyte-client[80089]: System call "open" of process 82060 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:12 devstack sudo[82037]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110" returned: 0 in 1.245s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:12 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_keu0w91ndevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:31:12 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Converted 112.00 MB image at 89.85 MB/s
Sep 30 15:31:12 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce4b390-3ad7-42b9-a621-d54c9f72c6e0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:12 devstack quobyte-client[80089]: System call "open" of process 82115 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110" returned: 0 in 0.209s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:13 devstack quobyte-client[80089]: System call "getattr" of process 82156 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 1G" returned: 0 in 0.177s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Downloaded image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume 7f8b3775-8123-4e4a-9de2-ecd2429b3110 successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 for user ece9b176aba94907bdd7f5bd651d83a8 is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Marking volume 7f8b3775-8123-4e4a-9de2-ecd2429b3110 as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Copying metadata from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 to 7f8b3775-8123-4e4a-9de2-ecd2429b3110. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Creating volume glance metadata for volume 7f8b3775-8123-4e4a-9de2-ecd2429b3110 backed by image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0016c1-796f-4920-9ac2-848f5f7d7820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423898940>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89675c7c-250c-4fa9-bc17-306631d32fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:13 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Volume volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 (7f8b3775-8123-4e4a-9de2-ecd2429b3110): created successfully
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89675c7c-250c-4fa9-bc17-306631d32fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Flow 'volume_create_manager' (cd65e056-1634-4b98-a633-119c576d919e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:13 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7cfc2dd6-d3ed-45e9-bfd6-b3db44da529d tempest-VolumesImageMetadata-1236893739 None] Created volume successfully.
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Acquiring lock "cinder-7f8b3775-8123-4e4a-9de2-ecd2429b3110-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Lock "cinder-7f8b3775-8123-4e4a-9de2-ecd2429b3110-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Acquiring lock "cinder-quobyte-7f8b3775-8123-4e4a-9de2-ecd2429b3110" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Lock "cinder-quobyte-7f8b3775-8123-4e4a-9de2-ecd2429b3110" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[188f19e5-386d-4f7e-af6f-578a56aa185d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f8b3775-8123-4e4a-9de2-ecd2429b3110" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Lock "cinder-quobyte-7f8b3775-8123-4e4a-9de2-ecd2429b3110" released by "delete_volume" :: held 0.196s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Created reservations ['60b828c1-a73e-498e-8b51-baa3bc73783f', 'f8e2d67c-5619-4d96-a2e3-f304e8bab15c', 'c0b250de-3228-434e-b444-15b15b45cb55', '4c06fe06-9f23-4aad-9483-334a871cbb2f'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:14 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Deleted volume successfully.
Sep 30 15:31:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-090346df-2f5b-4f49-a853-9f784b09737c tempest-VolumesImageMetadata-1236893739 None] Lock "cinder-7f8b3775-8123-4e4a-9de2-ecd2429b3110-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-5d5d4bce-2963-4e5e-aafa-81140460e5da req-2dc7521c-65f5-474b-9099-5d87295cdb97 tempest-DeleteServersTestJSON-593869180 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-5d5d4bce-2963-4e5e-aafa-81140460e5da req-2dc7521c-65f5-474b-9099-5d87295cdb97 tempest-DeleteServersTestJSON-593869180 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:15 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-5d5d4bce-2963-4e5e-aafa-81140460e5da req-2dc7521c-65f5-474b-9099-5d87295cdb97 tempest-DeleteServersTestJSON-593869180 None] Terminate volume connection completed successfully.
Sep 30 15:31:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-5d5d4bce-2963-4e5e-aafa-81140460e5da req-2dc7521c-65f5-474b-9099-5d87295cdb97 tempest-DeleteServersTestJSON-593869180 None] Deleting attachment ba43693f-dc5a-4e00-90fa-309eb2b48a2e. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Acquiring lock "cinder-05bb47e3-4fd1-422d-b9b2-7af07ca02d05-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Lock "cinder-05bb47e3-4fd1-422d-b9b2-7af07ca02d05-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Acquiring lock "cinder-quobyte-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Lock "cinder-quobyte-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad8ad7-3ad7-4986-8658-08403617d2cd]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" returned: 0 in 0.178s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Lock "cinder-quobyte-05bb47e3-4fd1-422d-b9b2-7af07ca02d05" released by "delete_volume" :: held 0.294s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=86,cinder:SELECT=66,cinder:INSERT=28,cinder:DELETE=7 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:31:18 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Created reservations ['715dc1f0-2729-4b58-b3f3-3d12ce2403d9', '1250488c-ab57-482a-9f00-b3605d2f2917', 'e7802de5-750f-4b43-84e5-7fd46fb003bf', '9f668b5f-4348-4021-9445-f211bca90425'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Deleted volume successfully.
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-04c6ce7d-1105-44f7-b7a4-2cb511b77674 tempest-DeleteServersTestJSON-593869180 None] Lock "cinder-05bb47e3-4fd1-422d-b9b2-7af07ca02d05-delete_volume" released by "delete_volume" :: held 0.487s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Flow 'volume_create_manager' (ddbe2eb5-7223-4e69-b5ae-1627d31fa443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588b71d8-320d-45fe-8314-c952779c51b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588b71d8-320d-45fe-8314-c952779c51b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-558788705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812c4763-7022-42c8-97b9-f224bf543792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cff61858424952ab743cbca6145460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:20Z,use_quota=True,user_id='99d84bfe239a458591d0771ad2b53cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd36de5e-7436-473d-bea4-e95563553db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd36de5e-7436-473d-bea4-e95563553db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d16c83-52f4-42d9-b2ce-42a30f6db92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d16c83-52f4-42d9-b2ce-42a30f6db92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812c4763-7022-42c8-97b9-f224bf543792', 'volume_name': 'volume-812c4763-7022-42c8-97b9-f224bf543792', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340fdcc7-a9a9-4d5e-8156-35edcbfc61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340fdcc7-a9a9-4d5e-8156-35edcbfc61dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa43ceb5-49be-4b67-a276-aadae82b0356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:19 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Volume 812c4763-7022-42c8-97b9-f224bf543792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812c4763-7022-42c8-97b9-f224bf543792', 'volume_size': 1}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-558788705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812c4763-7022-42c8-97b9-f224bf543792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cff61858424952ab743cbca6145460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:20Z,use_quota=True,user_id='99d84bfe239a458591d0771ad2b53cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Creating volume 812c4763-7022-42c8-97b9-f224bf543792 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:19 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:20 devstack quobyte-client[80089]: System call "lookup" of process 82182 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:20 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=13, name=volume-812c4763-7022-42c8-97b9-f224bf543792, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792 1073741824" returned: 0 in 0.209s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] <== create_volume: return (259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.262s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa43ceb5-49be-4b67-a276-aadae82b0356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812c4763-7022-42c8-97b9-f224bf543792', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb1a35-2a0f-466a-b420-dec62aafa5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Volume volume-812c4763-7022-42c8-97b9-f224bf543792 (812c4763-7022-42c8-97b9-f224bf543792): created successfully
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb1a35-2a0f-466a-b420-dec62aafa5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Flow 'volume_create_manager' (ddbe2eb5-7223-4e69-b5ae-1627d31fa443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c26a0b68-fdfd-4a06-97cf-ab02a2928a5e tempest-AbsoluteLimitsTests-1537174582 None] Created volume successfully.
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Acquiring lock "cinder-812c4763-7022-42c8-97b9-f224bf543792-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Lock "cinder-812c4763-7022-42c8-97b9-f224bf543792-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Acquiring lock "cinder-quobyte-812c4763-7022-42c8-97b9-f224bf543792" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Lock "cinder-quobyte-812c4763-7022-42c8-97b9-f224bf543792" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[31df9741-0318-4457-9c18-8e23ec73c891]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792" returned: 0 in 0.175s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-812c4763-7022-42c8-97b9-f224bf543792" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Lock "cinder-quobyte-812c4763-7022-42c8-97b9-f224bf543792" released by "delete_volume" :: held 0.239s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Created reservations ['f3566f0e-9092-4740-9d28-a7151d34cdb0', '14091eb1-7f7a-4e83-b975-44926efcdc10', '6e21343f-8769-4394-879e-e5c52c34d1f5', 'e9bfc95b-a8dc-4d62-8349-364b34e4cd01'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.038s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Deleted volume successfully.
Sep 30 15:31:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-173705eb-0245-4e33-b85e-d7bfa3a48cae tempest-AbsoluteLimitsTests-1537174582 None] Lock "cinder-812c4763-7022-42c8-97b9-f224bf543792-delete_volume" released by "delete_volume" :: held 0.433s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Flow 'volume_create_manager' (a514816f-626b-48d9-ab8d-eddf3d68691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed843f73-c9ff-458b-a793-20197fad5f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed843f73-c9ff-458b-a793-20197fad5f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1013695174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13ce507-a265-44f2-9784-7f5f81e4b4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6840e9a0a1b4950894aa5131e5bc9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:27Z,use_quota=True,user_id='aa77d9bab5164f7091bdfb4b070306d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35d5b7b-f99d-488f-b741-5e1082064d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35d5b7b-f99d-488f-b741-5e1082064d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06794a88-21f8-484f-9b17-76c509b5be73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06794a88-21f8-484f-9b17-76c509b5be73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13ce507-a265-44f2-9784-7f5f81e4b4dd', 'volume_name': 'volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270f66ef-f4b6-4174-95c9-757b053d9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270f66ef-f4b6-4174-95c9-757b053d9a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad26acfc-7ed1-4ca3-8185-8d62641f50cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Volume c13ce507-a265-44f2-9784-7f5f81e4b4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd', 'volume_size': 1}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1013695174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13ce507-a265-44f2-9784-7f5f81e4b4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6840e9a0a1b4950894aa5131e5bc9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:27Z,use_quota=True,user_id='aa77d9bab5164f7091bdfb4b070306d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Creating volume c13ce507-a265-44f2-9784-7f5f81e4b4dd {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:27 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:27 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=14, name=volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd 1073741824" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd" returned: 0 in 0.042s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] <== create_volume: return (191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.194s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad26acfc-7ed1-4ca3-8185-8d62641f50cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6419c6-ae67-42ce-9a8f-e783f07541f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Volume volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd (c13ce507-a265-44f2-9784-7f5f81e4b4dd): created successfully
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6419c6-ae67-42ce-9a8f-e783f07541f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Flow 'volume_create_manager' (a514816f-626b-48d9-ab8d-eddf3d68691d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-77ebd1b5-1ecd-4fab-a399-a4b806f3a8c4 tempest-VolumesTransfersTest-2096898061 None] Created volume successfully.
Sep 30 15:31:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-8181db63-3905-41e3-b52e-74ccf7a57706 tempest-VolumesTransfersTest-712981868 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8181db63-3905-41e3-b52e-74ccf7a57706 tempest-VolumesTransfersTest-712981868 None] Transfer volume completed successfully.
Sep 30 15:31:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Acquiring lock "cinder-c13ce507-a265-44f2-9784-7f5f81e4b4dd-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-c13ce507-a265-44f2-9784-7f5f81e4b4dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Acquiring lock "cinder-quobyte-c13ce507-a265-44f2-9784-7f5f81e4b4dd" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-quobyte-c13ce507-a265-44f2-9784-7f5f81e4b4dd" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:29 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[067f12e5-c077-4bb9-a2a6-399262beae12]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd" returned: 0 in 0.212s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c13ce507-a265-44f2-9784-7f5f81e4b4dd" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-quobyte-c13ce507-a265-44f2-9784-7f5f81e4b4dd" released by "delete_volume" :: held 0.272s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Created reservations ['6c235c18-d52e-4bac-85b3-bc1c90c462a0', '0b2d19e6-ce3b-4132-93c9-76fff9e0dd71', '134bd365-308d-4ea0-9cb3-34e63ccbb281', 'e4b919e3-414e-43bc-9bc8-ec3e5cd30036'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:30 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Deleted volume successfully.
Sep 30 15:31:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32df50d6-9b5a-4a04-9370-008d2a62a5b7 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-c13ce507-a265-44f2-9784-7f5f81e4b4dd-delete_volume" released by "delete_volume" :: held 0.495s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Flow 'volume_create_manager' (97947c38-d4e4-4b56-b4e5-6c2b5ce6fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed08ffd9-f65a-443b-af9f-5e2d0d1171e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed08ffd9-f65a-443b-af9f-5e2d0d1171e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1765341486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a558a822-8342-405b-a832-d1ffcef9c33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6840e9a0a1b4950894aa5131e5bc9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:31Z,use_quota=True,user_id='aa77d9bab5164f7091bdfb4b070306d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be49f27-357e-4e13-9bcc-928eb067ce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be49f27-357e-4e13-9bcc-928eb067ce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da91d919-41c9-45ca-a508-f0560eebffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da91d919-41c9-45ca-a508-f0560eebffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a558a822-8342-405b-a832-d1ffcef9c33f', 'volume_name': 'volume-a558a822-8342-405b-a832-d1ffcef9c33f', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56811125-3c00-4c2e-a667-43f8bd893a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56811125-3c00-4c2e-a667-43f8bd893a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38105a6b-af74-4039-9319-2ccd89dbe3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Volume a558a822-8342-405b-a832-d1ffcef9c33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a558a822-8342-405b-a832-d1ffcef9c33f', 'volume_size': 1}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1765341486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a558a822-8342-405b-a832-d1ffcef9c33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6840e9a0a1b4950894aa5131e5bc9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:31Z,use_quota=True,user_id='aa77d9bab5164f7091bdfb4b070306d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Creating volume a558a822-8342-405b-a832-d1ffcef9c33f {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=15, name=volume-a558a822-8342-405b-a832-d1ffcef9c33f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f 1073741824" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] <== create_volume: return (186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.189s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38105a6b-af74-4039-9319-2ccd89dbe3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a558a822-8342-405b-a832-d1ffcef9c33f', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f765ed0-e137-472b-9966-2e4c3332ab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Volume volume-a558a822-8342-405b-a832-d1ffcef9c33f (a558a822-8342-405b-a832-d1ffcef9c33f): created successfully
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f765ed0-e137-472b-9966-2e4c3332ab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Flow 'volume_create_manager' (97947c38-d4e4-4b56-b4e5-6c2b5ce6fdab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5058a68b-c3dd-426d-8220-c905b35d3f70 tempest-VolumesTransfersTest-2096898061 None] Created volume successfully.
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Acquiring lock "cinder-a558a822-8342-405b-a832-d1ffcef9c33f-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-a558a822-8342-405b-a832-d1ffcef9c33f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Acquiring lock "cinder-quobyte-a558a822-8342-405b-a832-d1ffcef9c33f" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-quobyte-a558a822-8342-405b-a832-d1ffcef9c33f" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[724bd3ca-0288-4029-b41e-41401ad70359]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f" returned: 0 in 0.179s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a558a822-8342-405b-a832-d1ffcef9c33f" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-quobyte-a558a822-8342-405b-a832-d1ffcef9c33f" released by "delete_volume" :: held 0.235s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Created reservations ['b5c32c74-043c-421f-b70e-8a6079db5438', '112dcb01-b267-453a-a0ba-cd9df0c9f74d', '5696fcc3-5610-4d19-9496-a6f5e17d08d5', '7d278809-83fc-419d-bd22-64d179a223e2'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:33 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Deleted volume successfully.
Sep 30 15:31:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-798c3446-610f-4e76-b553-6f407de02eb9 tempest-VolumesTransfersTest-970758978 None] Lock "cinder-a558a822-8342-405b-a832-d1ffcef9c33f-delete_volume" released by "delete_volume" :: held 0.436s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=65,cinder:UPDATE=95,cinder:DELETE=10,cinder:INSERT=22 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:31:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Flow 'volume_create_manager' (394bd53a-92cd-44d6-bb5c-3e38368b5306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dc30fe-5be7-4347-9812-3a98866d08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dc30fe-5be7-4347-9812-3a98866d08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-748839810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6229f0-c796-470d-acbd-34aa3a1fe375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae05db6a5154e1c9083f718dbdeb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:40Z,use_quota=True,user_id='7f3373079956479cb6d3126cfe5fdad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c304c3-8647-4b70-8136-9696d55717f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c304c3-8647-4b70-8136-9696d55717f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1d5316-de19-4975-b1cc-e9d50bfcc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:31:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Flow 'volume_create_manager' (12ff6d0c-6e91-4ec5-960e-606bbefb7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98b336a-ed18-499b-ac69-88253cd69c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98b336a-ed18-499b-ac69-88253cd69c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1177271943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14a630cd7c47481892b7ab1723ce59b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:41Z,use_quota=True,user_id='7ead2e900c454016a3f5a331e53839a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49e0401-2aea-4177-a208-91a9e493fe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49e0401-2aea-4177-a208-91a9e493fe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a0e1d1-5829-4776-a50c-34778c8d04a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a0e1d1-5829-4776-a50c-34778c8d04a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564', 'volume_name': 'volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5677f5f-6773-4a4a-b12b-3eee93d0057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5677f5f-6773-4a4a-b12b-3eee93d0057c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e8bdb6-0e81-448b-b418-b5cc78047aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Volume 2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564', 'volume_size': 1}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1177271943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14a630cd7c47481892b7ab1723ce59b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:41Z,use_quota=True,user_id='7ead2e900c454016a3f5a331e53839a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Creating volume 2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:40 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1d5316-de19-4975-b1cc-e9d50bfcc16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf6229f0-c796-470d-acbd-34aa3a1fe375', 'volume_name': 'volume-bf6229f0-c796-470d-acbd-34aa3a1fe375', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423cb3010>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3591661-3576-41ca-b195-b18816b5f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3591661-3576-41ca-b195-b18816b5f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7eeb3cf-9816-4546-a263-f3b21dfef263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:40 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Volume bf6229f0-c796-470d-acbd-34aa3a1fe375: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf6229f0-c796-470d-acbd-34aa3a1fe375', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423cb3010>}
Sep 30 15:31:40 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Cloning bf6229f0-c796-470d-acbd-34aa3a1fe375 from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31  at location (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:31:40 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=16, name=volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 1073741824" returned: 0 in 0.174s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564" returned: 0 in 0.043s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] <== create_volume: return (223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.226s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e8bdb6-0e81-448b-b418-b5cc78047aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e710e271-2514-4c2e-808a-0367e428be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:41 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Volume volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 (2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564): created successfully
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e710e271-2514-4c2e-808a-0367e428be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Flow 'volume_create_manager' (12ff6d0c-6e91-4ec5-960e-606bbefb7343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:41 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3089ac64-c0ec-4c51-989a-3285107330e7 tempest-VolumesListTestJSON-25822322 None] Created volume successfully.
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:31:41 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[01381b72-5f4a-4818-8ac2-e1009638fc1a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:41 devstack sudo[82267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD
Sep 30 15:31:41 devstack sudo[82267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:41 devstack sudo[82267]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 is fetched for user 7f3373079956479cb6d3126cfe5fdad2. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e56b9-e590-4b03-9d10-b35ae5d013be]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:41 devstack sudo[82276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD
Sep 30 15:31:41 devstack sudo[82276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:42 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Flow 'volume_create_manager' (8aadce6c-e57f-483b-88b1-3fb3e681404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685dc84f-bb55-4a0d-b19a-e577945c0025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685dc84f-bb55-4a0d-b19a-e577945c0025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-536563238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fce09fa-c21f-40ac-8140-6edba8074a4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14a630cd7c47481892b7ab1723ce59b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:42Z,use_quota=True,user_id='7ead2e900c454016a3f5a331e53839a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6fe2ef-e981-44f0-9c66-67fc003d6ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6fe2ef-e981-44f0-9c66-67fc003d6ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c9939f-72ce-4de2-bfe9-906eb2306338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c9939f-72ce-4de2-bfe9-906eb2306338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fce09fa-c21f-40ac-8140-6edba8074a4d', 'volume_name': 'volume-4fce09fa-c21f-40ac-8140-6edba8074a4d', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a1abe6-ffdc-402d-9ea1-bb77c9b9c03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a1abe6-ffdc-402d-9ea1-bb77c9b9c03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b261f20-5769-4bc3-8b4c-1c13f3c04d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:42 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Volume 4fce09fa-c21f-40ac-8140-6edba8074a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fce09fa-c21f-40ac-8140-6edba8074a4d', 'volume_size': 1}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-536563238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fce09fa-c21f-40ac-8140-6edba8074a4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14a630cd7c47481892b7ab1723ce59b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:42Z,use_quota=True,user_id='7ead2e900c454016a3f5a331e53839a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Creating volume 4fce09fa-c21f-40ac-8140-6edba8074a4d {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:42 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:42 devstack quobyte-client[80089]: System call "ioctl" of process 82279 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:42 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=17, name=volume-4fce09fa-c21f-40ac-8140-6edba8074a4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d 1073741824" returned: 0 in 0.123s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] <== create_volume: return (158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.160s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:42 devstack sudo[82276]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-748839810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6229f0-c796-470d-acbd-34aa3a1fe375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae05db6a5154e1c9083f718dbdeb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:40Z,use_quota=True,user_id='7f3373079956479cb6d3126cfe5fdad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Creating volume bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:42 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b261f20-5769-4bc3-8b4c-1c13f3c04d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fce09fa-c21f-40ac-8140-6edba8074a4d', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9646afe1-5838-43dc-bb07-d49e2213ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:42 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=18, name=volume-bf6229f0-c796-470d-acbd-34aa3a1fe375, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:42 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Volume volume-4fce09fa-c21f-40ac-8140-6edba8074a4d (4fce09fa-c21f-40ac-8140-6edba8074a4d): created successfully
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9646afe1-5838-43dc-bb07-d49e2213ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Flow 'volume_create_manager' (8aadce6c-e57f-483b-88b1-3fb3e681404d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:42 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f0ab5447-b0dd-4186-90f9-7f3d6ad84ba3 tempest-VolumesListTestJSON-25822322 None] Created volume successfully.
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 1073741824" returned: 0 in 0.127s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] <== create_volume: return (151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.153s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Attempting download of 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume bf6229f0-c796-470d-acbd-34aa3a1fe375. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f311e-9cda-429d-ab0d-f3fa442b9148]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:42 devstack sudo[82296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4
Sep 30 15:31:42 devstack sudo[82296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:43 devstack sudo[82296]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4" returned: 0 in 0.544s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:43 devstack sudo[82311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4
Sep 30 15:31:43 devstack sudo[82311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:43 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Flow 'volume_create_manager' (f8f7be57-c850-41fc-8e11-99c7606e770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfcb9de-41b1-4492-b601-e4ddfb014472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfcb9de-41b1-4492-b601-e4ddfb014472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1678817576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052e13cf-fe2e-44ee-892b-abd67621d170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14a630cd7c47481892b7ab1723ce59b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:43Z,use_quota=True,user_id='7ead2e900c454016a3f5a331e53839a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5bb2a4-864a-40e9-96f0-a06cc63c1bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5bb2a4-864a-40e9-96f0-a06cc63c1bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d6a9ec-02d1-49a2-affe-174a0a8af082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d6a9ec-02d1-49a2-affe-174a0a8af082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052e13cf-fe2e-44ee-892b-abd67621d170', 'volume_name': 'volume-052e13cf-fe2e-44ee-892b-abd67621d170', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd7a97b-4bca-4d62-b4a5-5da16031d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd7a97b-4bca-4d62-b4a5-5da16031d93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8606ed58-9dc4-4617-aa86-8734cdb7af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Volume 052e13cf-fe2e-44ee-892b-abd67621d170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052e13cf-fe2e-44ee-892b-abd67621d170', 'volume_size': 1}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1678817576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052e13cf-fe2e-44ee-892b-abd67621d170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14a630cd7c47481892b7ab1723ce59b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:43Z,use_quota=True,user_id='7ead2e900c454016a3f5a331e53839a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Creating volume 052e13cf-fe2e-44ee-892b-abd67621d170 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:43 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:43 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=19, name=volume-052e13cf-fe2e-44ee-892b-abd67621d170, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170 1073741824" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] <== create_volume: return (206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.209s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8606ed58-9dc4-4617-aa86-8734cdb7af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052e13cf-fe2e-44ee-892b-abd67621d170', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886a25f4-5b2d-4364-ba61-c9909853cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Volume volume-052e13cf-fe2e-44ee-892b-abd67621d170 (052e13cf-fe2e-44ee-892b-abd67621d170): created successfully
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886a25f4-5b2d-4364-ba61-c9909853cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Flow 'volume_create_manager' (f8f7be57-c850-41fc-8e11-99c7606e770a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:43 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9d347271-0f1c-4686-adf5-a525ceff265e tempest-VolumesListTestJSON-25822322 None] Created volume successfully.
Sep 30 15:31:43 devstack sudo[82311]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4" returned: 1 in 0.690s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_jti788a4' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e237f6-3e2a-4079-90ac-4570017eeaf9]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:43 devstack sudo[82323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD
Sep 30 15:31:43 devstack sudo[82323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:44 devstack sudo[82323]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:44 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 was qcow2, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:31:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:44 devstack sudo[82328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375
Sep 30 15:31:44 devstack sudo[82328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:31:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:45 devstack sudo[82328]: pam_unix(sudo:session): session closed for user root
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375" returned: 0 in 0.918s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_m5bl3i8mdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:31:45 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8cf00b-ccd0-432f-b7aa-f42f890d5103]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:45 devstack quobyte-client[80089]: System call "lookup" of process 82341 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:45 devstack quobyte-client[80089]: System call "open" of process 82341 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375" returned: 0 in 0.222s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 1G" returned: 0 in 0.092s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Downloaded image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume bf6229f0-c796-470d-acbd-34aa3a1fe375 successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 for user 7f3373079956479cb6d3126cfe5fdad2 is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Marking volume bf6229f0-c796-470d-acbd-34aa3a1fe375 as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Copying metadata from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 to bf6229f0-c796-470d-acbd-34aa3a1fe375. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Creating volume glance metadata for volume bf6229f0-c796-470d-acbd-34aa3a1fe375 backed by image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7eeb3cf-9816-4546-a263-f3b21dfef263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6229f0-c796-470d-acbd-34aa3a1fe375', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423cb3010>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1b4c26-a0d7-47d9-b82c-8122f8d406bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:45 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Volume volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 (bf6229f0-c796-470d-acbd-34aa3a1fe375): created successfully
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1b4c26-a0d7-47d9-b82c-8122f8d406bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:45 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Flow 'volume_create_manager' (394bd53a-92cd-44d6-bb5c-3e38368b5306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:45 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bafbfce3-8e3d-402c-881c-0fc1e57c272e tempest-TaggedBootDevicesTest-1241606807 None] Created volume successfully.
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Acquiring lock "cinder-052e13cf-fe2e-44ee-892b-abd67621d170-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Lock "cinder-052e13cf-fe2e-44ee-892b-abd67621d170-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:46 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Acquiring lock "cinder-quobyte-052e13cf-fe2e-44ee-892b-abd67621d170" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Lock "cinder-quobyte-052e13cf-fe2e-44ee-892b-abd67621d170" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb70d60c-fe5e-43c3-9aa6-28bb5db6403d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-052e13cf-fe2e-44ee-892b-abd67621d170" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Lock "cinder-quobyte-052e13cf-fe2e-44ee-892b-abd67621d170" released by "delete_volume" :: held 0.229s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:46 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Created reservations ['9217e8d2-0ccb-4f49-837a-d89395a561e0', '51e92829-32eb-480e-a36e-9c38f234b058', '5dde240c-5916-4cd2-938f-4e5caa441fda', '5d0110b5-501a-4eec-84cd-699badab25d5'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:47 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Deleted volume successfully.
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b782ad3b-799d-4c41-a16a-d1abe4ce9e2d tempest-VolumesListTestJSON-25822322 None] Lock "cinder-052e13cf-fe2e-44ee-892b-abd67621d170-delete_volume" released by "delete_volume" :: held 0.460s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:47 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Flow 'volume_create_manager' (a89892e7-e22f-4af2-b609-6cbf3d832609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1bd656-868d-409a-a1cc-cba4abf5a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1bd656-868d-409a-a1cc-cba4abf5a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-456541498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922fb625-476e-45ca-b241-0ad8cfdfd9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae05db6a5154e1c9083f718dbdeb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:47Z,use_quota=True,user_id='7f3373079956479cb6d3126cfe5fdad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4239889d-4031-485c-a1bb-f15e422d70fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4239889d-4031-485c-a1bb-f15e422d70fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070b9612-63ba-4119-88be-609c67cb2ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070b9612-63ba-4119-88be-609c67cb2ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '922fb625-476e-45ca-b241-0ad8cfdfd9a2', 'volume_name': 'volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895cbe3f-3a5c-49bd-9e5d-0c04729b4837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895cbe3f-3a5c-49bd-9e5d-0c04729b4837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d970018-b243-4f58-bfdc-e5e39822c459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:47 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Volume 922fb625-476e-45ca-b241-0ad8cfdfd9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2', 'volume_size': 1}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-456541498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922fb625-476e-45ca-b241-0ad8cfdfd9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae05db6a5154e1c9083f718dbdeb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:47Z,use_quota=True,user_id='7f3373079956479cb6d3126cfe5fdad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Creating volume 922fb625-476e-45ca-b241-0ad8cfdfd9a2 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:47 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:47 devstack quobyte-client[80089]: System call "ioctl" of process 82364 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:47 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=20, name=volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 1073741824" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] <== create_volume: return (169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.171s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d970018-b243-4f58-bfdc-e5e39822c459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24db472b-ecfb-46e1-b9c8-f984c0692e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:47 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Volume volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 (922fb625-476e-45ca-b241-0ad8cfdfd9a2): created successfully
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24db472b-ecfb-46e1-b9c8-f984c0692e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Flow 'volume_create_manager' (a89892e7-e22f-4af2-b609-6cbf3d832609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:47 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c4c1bf59-d0c1-4c6a-81cf-1a1aa15761e7 tempest-TaggedBootDevicesTest-1241606807 None] Created volume successfully.
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "cinder-4fce09fa-c21f-40ac-8140-6edba8074a4d-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-4fce09fa-c21f-40ac-8140-6edba8074a4d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:47 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "cinder-quobyte-4fce09fa-c21f-40ac-8140-6edba8074a4d" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-quobyte-4fce09fa-c21f-40ac-8140-6edba8074a4d" acquired by "delete_volume" :: waited 0.016s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df7a86-2c73-4f92-926b-cae385d4fc17]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4fce09fa-c21f-40ac-8140-6edba8074a4d" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-quobyte-4fce09fa-c21f-40ac-8140-6edba8074a4d" released by "delete_volume" :: held 0.187s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Created reservations ['4cc86912-f6d9-47f4-aa5e-d694598dcad8', '03658f28-8767-48b2-82e9-5d6b70819cd6', 'd5b01ebd-8fb0-4436-b26a-8b72311af337', '73c274f7-21da-4635-a6a2-8347166296e3'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:48 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Deleted volume successfully.
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a3b20334-c497-40fa-b8eb-1a07987ea991 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-4fce09fa-c21f-40ac-8140-6edba8074a4d-delete_volume" released by "delete_volume" :: held 0.364s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:48 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Flow 'volume_create_manager' (7989a6ee-1a37-445d-8e58-4c75b7cc52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418b29bd-9de1-441c-a590-d76893d050d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418b29bd-9de1-441c-a590-d76893d050d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-921685298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6664cb87-875c-4185-b1a0-f87d15f88a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae05db6a5154e1c9083f718dbdeb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:48Z,use_quota=True,user_id='7f3373079956479cb6d3126cfe5fdad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8e10e2-4c89-422f-bd23-1d4b70a30fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8e10e2-4c89-422f-bd23-1d4b70a30fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4872935-b4f7-4090-87e4-3d80ecf5e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4872935-b4f7-4090-87e4-3d80ecf5e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6664cb87-875c-4185-b1a0-f87d15f88a5a', 'volume_name': 'volume-6664cb87-875c-4185-b1a0-f87d15f88a5a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98632d53-5885-4406-ac04-89c0792c8b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98632d53-5885-4406-ac04-89c0792c8b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcfc60e-c766-4318-a35c-87029c3adb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:48 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Volume 6664cb87-875c-4185-b1a0-f87d15f88a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6664cb87-875c-4185-b1a0-f87d15f88a5a', 'volume_size': 1}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-921685298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6664cb87-875c-4185-b1a0-f87d15f88a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae05db6a5154e1c9083f718dbdeb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:31:48Z,use_quota=True,user_id='7f3373079956479cb6d3126cfe5fdad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Creating volume 6664cb87-875c-4185-b1a0-f87d15f88a5a {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:31:48 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:48 devstack quobyte-client[80089]: System call "getlk" of process 82379 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:31:48 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=21, name=volume-6664cb87-875c-4185-b1a0-f87d15f88a5a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a 1073741824" returned: 0 in 0.130s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] <== create_volume: return (159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.161s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcfc60e-c766-4318-a35c-87029c3adb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6664cb87-875c-4185-b1a0-f87d15f88a5a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af8ed74-f96d-4202-9b49-062c69fb3dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:31:48 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Volume volume-6664cb87-875c-4185-b1a0-f87d15f88a5a (6664cb87-875c-4185-b1a0-f87d15f88a5a): created successfully
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af8ed74-f96d-4202-9b49-062c69fb3dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:31:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Flow 'volume_create_manager' (7989a6ee-1a37-445d-8e58-4c75b7cc52e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:31:48 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-48be7eea-8c0e-4817-a732-26e7a0e64f6f tempest-TaggedBootDevicesTest-1241606807 None] Created volume successfully.
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "cinder-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "cinder-quobyte-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-quobyte-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[393ca89e-bd0e-49ce-86af-def2dc661267]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-quobyte-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564" released by "delete_volume" :: held 0.181s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Created reservations ['63e4612b-ceb1-4710-954e-99a3baa72889', 'ff810e33-f73d-4499-a1af-c0c7ecef464d', 'c3a2f76d-0e9a-4a49-9675-4325989fc135', '5af415be-f2d6-4e80-a450-fa209c4e4c3c'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:31:49 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Deleted volume successfully.
Sep 30 15:31:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf678508-4550-4bc1-9536-c00ec5f27c88 tempest-VolumesListTestJSON-25822322 None] Lock "cinder-2fbd6c4f-cd0e-4f77-9b9c-18b1383ea564-delete_volume" released by "delete_volume" :: held 0.327s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:31:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:31:59 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=52,cinder:INSERT=19,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:31:59 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=30,cinder:UPDATE=32,cinder:DELETE=6,cinder:INSERT=13 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:31:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Flow 'volume_create_manager' (da105001-275e-4ccb-8457-27d2413c3516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba976a4-19c4-4029-9eb3-6aba941eb950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba976a4-19c4-4029-9eb3-6aba941eb950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1764553720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d99eab-711b-4c44-ae6c-c9883b262de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8fb5e4d493c45be8f4db18f0b8d221a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:32:03Z,use_quota=True,user_id='4f64ba95abfe46068491ba15858e0c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b8c46a-10cd-415a-b760-ca8f0c20401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b8c46a-10cd-415a-b760-ca8f0c20401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24110614-08a9-4803-87cc-68f179680cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24110614-08a9-4803-87cc-68f179680cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d99eab-711b-4c44-ae6c-c9883b262de9', 'volume_name': 'volume-61d99eab-711b-4c44-ae6c-c9883b262de9', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d48e91-ce20-4a2b-80d6-ae686becc918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d48e91-ce20-4a2b-80d6-ae686becc918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfca2fb-a61c-41c9-b579-e4fa547e014d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:02 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Volume 61d99eab-711b-4c44-ae6c-c9883b262de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d99eab-711b-4c44-ae6c-c9883b262de9', 'volume_size': 1}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1764553720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d99eab-711b-4c44-ae6c-c9883b262de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8fb5e4d493c45be8f4db18f0b8d221a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:32:03Z,use_quota=True,user_id='4f64ba95abfe46068491ba15858e0c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Creating volume 61d99eab-711b-4c44-ae6c-c9883b262de9 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:32:02 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:32:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:03 devstack quobyte-client[80089]: System call "lookup" of process 82394 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:03 devstack quobyte-client[80089]: System call "create" of process 82394 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:03 devstack quobyte-client[80089]: System call "getattr" of process 82394 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:03 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=22, name=volume-61d99eab-711b-4c44-ae6c-c9883b262de9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9 1073741824" returned: 0 in 0.190s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] <== create_volume: return (232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.235s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfca2fb-a61c-41c9-b579-e4fa547e014d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d99eab-711b-4c44-ae6c-c9883b262de9', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d76d496-7c47-4e43-af45-5eeb0a0fd62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:03 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Volume volume-61d99eab-711b-4c44-ae6c-c9883b262de9 (61d99eab-711b-4c44-ae6c-c9883b262de9): created successfully
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d76d496-7c47-4e43-af45-5eeb0a0fd62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:03 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Flow 'volume_create_manager' (da105001-275e-4ccb-8457-27d2413c3516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:32:03 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ad54d6d7-9337-4652-aa99-ce5a48a6e41a tempest-AttachVolumeShelveTestJSON-354420458 None] Created volume successfully.
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c37b2-cd90-4923-ab58-145e0695143e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375" returned: 0 in 0.191s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.203s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-bf6229f0-c796-470d-acbd-34aa3a1fe375', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b8f87a3-e593-4352-a9a8-640f174f002d', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:32:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-d955c4ad-0584-4683-bf64-90517220fdcf tempest-TaggedBootDevicesTest-1241606807 None] attachment_update completed successfully.
Sep 30 15:32:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[235be123-0a05-4bd7-90fd-1f9e23575bc7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2" returned: 0 in 0.196s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.208s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0bd43b1-e485-4d08-9c29-afab1ba09f8a', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:32:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-e249450c-313b-433f-b61d-bc866fcb7123 tempest-TaggedBootDevicesTest-1241606807 None] attachment_update completed successfully.
Sep 30 15:32:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Flow 'volume_create_manager' (f4e5f38b-4145-4dad-911e-a3075d4da280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd8e791-2841-40a3-ac3c-cc3e9039a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd8e791-2841-40a3-ac3c-cc3e9039a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1437465819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77dc3741-ddc2-4f10-8d9b-41ef8243237a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3796656cff14c19b8d20f16e605689b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:32:09Z,use_quota=True,user_id='0ad225fbacee409682d2d0af41d9d453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6b80f6-cba0-4307-a6f5-f52c2019365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6b80f6-cba0-4307-a6f5-f52c2019365b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7ff4bb-40fe-4b19-89b9-7ded1dd045e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7ff4bb-40fe-4b19-89b9-7ded1dd045e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77dc3741-ddc2-4f10-8d9b-41ef8243237a', 'volume_name': 'volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809e1323-61ab-42b7-8a44-869393778ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809e1323-61ab-42b7-8a44-869393778ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605dab25-0813-4a84-b427-abb2ca22fbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume 77dc3741-ddc2-4f10-8d9b-41ef8243237a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a', 'volume_size': 1}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1437465819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77dc3741-ddc2-4f10-8d9b-41ef8243237a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3796656cff14c19b8d20f16e605689b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:32:09Z,use_quota=True,user_id='0ad225fbacee409682d2d0af41d9d453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Creating volume 77dc3741-ddc2-4f10-8d9b-41ef8243237a {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:09 devstack quobyte-client[80089]: System call "ioctl" of process 82504 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:09 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=23, name=volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:32:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Flow 'volume_create_manager' (d46e0bf3-5d76-4597-88c6-67bf2a8df819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d147e140-3bf2-496b-aa26-15e337f911e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a 1073741824" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d147e140-3bf2-496b-aa26-15e337f911e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-456686993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d107d2cd-2c52-4fbd-8170-c5578b7b5dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3796656cff14c19b8d20f16e605689b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:32:09Z,use_quota=True,user_id='0ad225fbacee409682d2d0af41d9d453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0051f01b-3cb8-42e0-8c77-acde5c585773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0051f01b-3cb8-42e0-8c77-acde5c585773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc944cf-8ecb-4eda-a82a-663b74561bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc944cf-8ecb-4eda-a82a-663b74561bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd107d2cd-2c52-4fbd-8170-c5578b7b5dc9', 'volume_name': 'volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5cb4fe-8024-49e9-9e2a-ae47cab111cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5cb4fe-8024-49e9-9e2a-ae47cab111cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddceafd7-5ff7-4dbe-a5a1-481f8650662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume d107d2cd-2c52-4fbd-8170-c5578b7b5dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9', 'volume_size': 1}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a" returned: 0 in 0.046s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] <== create_volume: return (193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.195s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-456686993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d107d2cd-2c52-4fbd-8170-c5578b7b5dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3796656cff14c19b8d20f16e605689b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:32:09Z,use_quota=True,user_id='0ad225fbacee409682d2d0af41d9d453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Creating volume d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605dab25-0813-4a84-b427-abb2ca22fbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f486bf14-dd71-4499-88e4-df0316f56f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack quobyte-client[80089]: System call "lookup" of process 82516 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a (77dc3741-ddc2-4f10-8d9b-41ef8243237a): created successfully
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f486bf14-dd71-4499-88e4-df0316f56f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Flow 'volume_create_manager' (f4e5f38b-4145-4dad-911e-a3075d4da280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:32:09 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=24, name=volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-232839c1-5a11-4d37-a287-60b13dba6ad5 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Created volume successfully.
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 1073741824" returned: 0 in 0.211s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] <== create_volume: return (265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.268s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddceafd7-5ff7-4dbe-a5a1-481f8650662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6814190d-2be0-4e36-bb68-6a37b6f7b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 (d107d2cd-2c52-4fbd-8170-c5578b7b5dc9): created successfully
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6814190d-2be0-4e36-bb68-6a37b6f7b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Flow 'volume_create_manager' (d46e0bf3-5d76-4597-88c6-67bf2a8df819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:32:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7a306e9f-909e-4060-8144-6b67ae21c614 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Created volume successfully.
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc6eb71-4b11-4097-8b4c-0112cdf9cd00]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:32:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a" returned: 0 in 0.166s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.174s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-6664cb87-875c-4185-b1a0-f87d15f88a5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acfb87d6-3619-4d06-9583-8017a629e3db', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:32:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-28dd0c75-3883-4c7e-b490-a20ee3f428cc req-21098cdb-065c-4407-8b3a-b73587d0d22d tempest-TaggedBootDevicesTest-1241606807 None] attachment_update completed successfully.
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad743bb-a09d-444c-af97-723f67c9fb28]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:32:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400" returned: 0 in 0.177s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.192s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-37ec3400-da6e-4f84-afc6-6853ce7ea400', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd812a1dd-d71e-4bbf-9742-09547ee9338e', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:32:11 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:11 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-275218f8-3b5d-4e5f-a1db-26753db045c6 req-bf355de6-469c-4f6e-8f1c-5f17773f421e tempest-VolumesAssistedSnapshotsTest-976842791 None] attachment_update completed successfully.
Sep 30 15:32:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:21 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=11,cinder:SELECT=22,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:32:21 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=28,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:32:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d5d2c4-e109-458e-a8cb-7649e75ac91d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:32:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9" returned: 0 in 0.166s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.174s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-61d99eab-711b-4c44-ae6c-c9883b262de9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9523a7b-033a-45cc-a531-a1721b06dba0', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:32:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-bc725af5-2cbb-439d-bfa0-eecb071868a8 req-a6fc8fe9-8191-40e1-ba38-9a8328a39d36 tempest-AttachVolumeShelveTestJSON-354420458 None] attachment_update completed successfully.
Sep 30 15:32:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:33 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:32:33 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:32:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-8703b259-3bcf-4b9e-971b-8a0d30dc458f req-e49ff001-c669-454c-ba54-679ec6bcd741 tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-8703b259-3bcf-4b9e-971b-8a0d30dc458f req-e49ff001-c669-454c-ba54-679ec6bcd741 tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-8703b259-3bcf-4b9e-971b-8a0d30dc458f req-e49ff001-c669-454c-ba54-679ec6bcd741 tempest-VolumesAssistedSnapshotsTest-976842791 None] Terminate volume connection completed successfully.
Sep 30 15:32:38 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-8703b259-3bcf-4b9e-971b-8a0d30dc458f req-e49ff001-c669-454c-ba54-679ec6bcd741 tempest-VolumesAssistedSnapshotsTest-976842791 None] Deleting attachment d812a1dd-d71e-4bbf-9742-09547ee9338e. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.043s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Acquiring lock "cinder-37ec3400-da6e-4f84-afc6-6853ce7ea400-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "cinder-37ec3400-da6e-4f84-afc6-6853ce7ea400-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:32:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Acquiring lock "cinder-quobyte-37ec3400-da6e-4f84-afc6-6853ce7ea400" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "cinder-quobyte-37ec3400-da6e-4f84-afc6-6853ce7ea400" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbdfe42-de8d-4a85-a5cb-ba3d01242029]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:40 devstack quobyte-client[80089]: System call "getattr" of process 83763 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:40 devstack quobyte-client[80089]: System call "open" of process 83763 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400" returned: 0 in 0.314s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-37ec3400-da6e-4f84-afc6-6853ce7ea400" returned: 0 in 0.111s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "cinder-quobyte-37ec3400-da6e-4f84-afc6-6853ce7ea400" released by "delete_volume" :: held 0.504s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Created reservations ['b5b92633-4115-4dfb-a7a2-f66595190c28', 'd2b64bf5-224b-432c-9710-f0a018fea1ba', '0c515151-9d4b-456f-a11d-88ded0d944c0', 'e3a9e179-0bbf-4771-afb7-a9a9ff89c1e0'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.050s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:32:41 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Deleted volume successfully.
Sep 30 15:32:41 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9ab9011-6689-4934-b948-4412de8ab6eb tempest-VolumesAssistedSnapshotsTest-976842791 None] Lock "cinder-37ec3400-da6e-4f84-afc6-6853ce7ea400-delete_volume" released by "delete_volume" :: held 0.920s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:32:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:32:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:32:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:32:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a772dbe7-e061-4f62-9fda-a9ca8146b4e6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.153s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:33:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9d3dddc-1f5b-4dfb-9709-be6ba0e492f5', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:33:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:33:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-146fc22b-346f-48c6-9802-14aa98daf442 req-afe3beee-1265-4e60-8466-ba2ae2a53c99 tempest-TestServerVolumeAttachmentScenario-2124322165 None] attachment_update completed successfully.
Sep 30 15:33:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f0b45-6aa8-4392-a0af-9db411a25a4d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.149s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:33:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1ff00bf-8906-49a7-8dca-dcaf6ec6407c', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:33:43 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:33:43 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-d0f9ddab-9428-40a6-b5d9-8e5b51d86dc0 req-ee7d3024-167a-423a-a5ba-5434e616edaf tempest-TestServerVolumeAttachmentScenario-2124322165 None] attachment_update completed successfully.
Sep 30 15:33:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:33:53 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:33:53 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:33:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-8f3b1dd8-2efe-482e-ae16-7c0198039dd9 req-1d44a767-ddc6-4813-a144-c93420f2a485 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-8f3b1dd8-2efe-482e-ae16-7c0198039dd9 req-1d44a767-ddc6-4813-a144-c93420f2a485 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-8f3b1dd8-2efe-482e-ae16-7c0198039dd9 req-1d44a767-ddc6-4813-a144-c93420f2a485 tempest-AttachVolumeShelveTestJSON-354420458 None] Terminate volume connection completed successfully.
Sep 30 15:34:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-8f3b1dd8-2efe-482e-ae16-7c0198039dd9 req-1d44a767-ddc6-4813-a144-c93420f2a485 tempest-AttachVolumeShelveTestJSON-354420458 None] Deleting attachment f9523a7b-033a-45cc-a531-a1721b06dba0. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:34:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-d0a99878-929f-48a5-a958-ced2e19b9658 req-f33b5ade-b908-4b5c-8348-cdc837fe3baa tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-d0a99878-929f-48a5-a958-ced2e19b9658 req-f33b5ade-b908-4b5c-8348-cdc837fe3baa tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-d0a99878-929f-48a5-a958-ced2e19b9658 req-f33b5ade-b908-4b5c-8348-cdc837fe3baa tempest-TestServerVolumeAttachmentScenario-2124322165 None] Terminate volume connection completed successfully.
Sep 30 15:34:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d0a99878-929f-48a5-a958-ced2e19b9658 req-f33b5ade-b908-4b5c-8348-cdc837fe3baa tempest-TestServerVolumeAttachmentScenario-2124322165 None] Deleting attachment d1ff00bf-8906-49a7-8dca-dcaf6ec6407c. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:34:12 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-a8d3f02a-507a-44e5-a1e9-6a991ca96f5a tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-a8d3f02a-507a-44e5-a1e9-6a991ca96f5a tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:13 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-a8d3f02a-507a-44e5-a1e9-6a991ca96f5a tempest-TaggedBootDevicesTest-1241606807 None] Terminate volume connection completed successfully.
Sep 30 15:34:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-a8d3f02a-507a-44e5-a1e9-6a991ca96f5a tempest-TaggedBootDevicesTest-1241606807 None] Deleting attachment acfb87d6-3619-4d06-9583-8017a629e3db. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:34:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-ae072a60-190f-40b9-ad7a-e483e44d3acf tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-ae072a60-190f-40b9-ad7a-e483e44d3acf tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:13 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-ae072a60-190f-40b9-ad7a-e483e44d3acf tempest-TaggedBootDevicesTest-1241606807 None] Terminate volume connection completed successfully.
Sep 30 15:34:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-ae072a60-190f-40b9-ad7a-e483e44d3acf tempest-TaggedBootDevicesTest-1241606807 None] Deleting attachment c0bd43b1-e485-4d08-9c29-afab1ba09f8a. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:34:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-446d6576-1435-41a6-a6df-12ea804eaa5a tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-446d6576-1435-41a6-a6df-12ea804eaa5a tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:14 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-446d6576-1435-41a6-a6df-12ea804eaa5a tempest-TaggedBootDevicesTest-1241606807 None] Terminate volume connection completed successfully.
Sep 30 15:34:14 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-39595636-967f-4bc4-bc4b-040a9047d1d3 req-446d6576-1435-41a6-a6df-12ea804eaa5a tempest-TaggedBootDevicesTest-1241606807 None] Deleting attachment 2b8f87a3-e593-4352-a9a8-640f174f002d. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:34:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "cinder-6664cb87-875c-4185-b1a0-f87d15f88a5a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-6664cb87-875c-4185-b1a0-f87d15f88a5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "cinder-quobyte-6664cb87-875c-4185-b1a0-f87d15f88a5a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-quobyte-6664cb87-875c-4185-b1a0-f87d15f88a5a" acquired by "delete_volume" :: waited 0.016s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d493aec-ef2f-44cd-beff-b4c5b79a94c1]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6664cb87-875c-4185-b1a0-f87d15f88a5a" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-quobyte-6664cb87-875c-4185-b1a0-f87d15f88a5a" released by "delete_volume" :: held 0.181s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Created reservations ['1474c6bd-1949-436d-a13c-8cc30b2f92b6', '97486a67-bc6a-4b49-97a6-499854d4209d', 'e53e8eb1-590f-44b6-a22f-c055eb6b0e78', 'f9e3836d-2c42-4b01-8ee7-93e49bda5802'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:34:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Deleted volume successfully.
Sep 30 15:34:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f786d94d-8557-4dde-ae0f-73938dbf2ab2 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-6664cb87-875c-4185-b1a0-f87d15f88a5a-delete_volume" released by "delete_volume" :: held 0.390s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "cinder-922fb625-476e-45ca-b241-0ad8cfdfd9a2-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-922fb625-476e-45ca-b241-0ad8cfdfd9a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "cinder-quobyte-922fb625-476e-45ca-b241-0ad8cfdfd9a2" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-quobyte-922fb625-476e-45ca-b241-0ad8cfdfd9a2" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bc3a7b-6715-466f-bbc6-49ea5bd18e07]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-922fb625-476e-45ca-b241-0ad8cfdfd9a2" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-quobyte-922fb625-476e-45ca-b241-0ad8cfdfd9a2" released by "delete_volume" :: held 0.195s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Created reservations ['d3e23cfe-4b32-4a4d-8d29-81f8a8b1d1cf', '3fb319ba-9f0e-4228-959c-36954d203a88', '25489ff5-030a-4eaa-a61d-50acd4b609be', '59fc4f8e-6fb8-4663-bbbe-84adcde93643'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:34:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Deleted volume successfully.
Sep 30 15:34:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02ad455b-4e30-4e87-8c4d-0d8edb4bd918 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-922fb625-476e-45ca-b241-0ad8cfdfd9a2-delete_volume" released by "delete_volume" :: held 0.347s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "cinder-bf6229f0-c796-470d-acbd-34aa3a1fe375-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-bf6229f0-c796-470d-acbd-34aa3a1fe375-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "cinder-quobyte-bf6229f0-c796-470d-acbd-34aa3a1fe375" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-quobyte-bf6229f0-c796-470d-acbd-34aa3a1fe375" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9ffca3-bca4-469b-8610-25cfcf6677a6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375" returned: 0 in 0.153s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf6229f0-c796-470d-acbd-34aa3a1fe375" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-quobyte-bf6229f0-c796-470d-acbd-34aa3a1fe375" released by "delete_volume" :: held 0.198s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Created reservations ['84264df5-c05f-4de6-bdcb-9806ed1c0e8e', '511b1073-2500-48e0-946e-ef8059e5db45', 'a0f1d0e0-d93b-483c-9fe8-6a1a6f09c0a4', '207b786d-54db-4347-b0e7-614d7480a0b4'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:34:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Deleted volume successfully.
Sep 30 15:34:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fadf8757-2741-4b66-8bfc-89fa179ba272 tempest-TaggedBootDevicesTest-1241606807 None] Lock "cinder-bf6229f0-c796-470d-acbd-34aa3a1fe375-delete_volume" released by "delete_volume" :: held 0.361s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:31 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=19,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:34:31 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=21,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:34:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-cf1b7c37-9b08-4c7b-8c85-2cd7649650e7 req-45753c74-bec6-4891-8d5c-97b79ad71a88 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-cf1b7c37-9b08-4c7b-8c85-2cd7649650e7 req-45753c74-bec6-4891-8d5c-97b79ad71a88 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-cf1b7c37-9b08-4c7b-8c85-2cd7649650e7 req-45753c74-bec6-4891-8d5c-97b79ad71a88 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Terminate volume connection completed successfully.
Sep 30 15:34:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-cf1b7c37-9b08-4c7b-8c85-2cd7649650e7 req-45753c74-bec6-4891-8d5c-97b79ad71a88 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Deleting attachment c9d3dddc-1f5b-4dfb-9709-be6ba0e492f5. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:34:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.065s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:34:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Flow 'volume_create_manager' (8019dc54-2ace-460f-ad68-3b16c6c9034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dd50fc-33e6-4a73-800a-3f0ea1c357cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dd50fc-33e6-4a73-800a-3f0ea1c357cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1708156378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84d043f-d3c6-4fc9-ac4f-f78f9639ae72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5088256a8ec942d6bb07525d4215e379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:34:40Z,use_quota=True,user_id='eb9e6af1624040f7aa28297bc25663b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73754612-ccf5-4150-ae49-2c527a79fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73754612-ccf5-4150-ae49-2c527a79fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcae9ce-d0ce-48a6-8271-e0dc9c1f79cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcae9ce-d0ce-48a6-8271-e0dc9c1f79cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84d043f-d3c6-4fc9-ac4f-f78f9639ae72', 'volume_name': 'volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6618387c-df1a-4ff1-bbc0-bbdb72184386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6618387c-df1a-4ff1-bbc0-bbdb72184386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1b55c2-34f2-4567-bd16-1ad777027454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:40 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume e84d043f-d3c6-4fc9-ac4f-f78f9639ae72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72', 'volume_size': 1}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1708156378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84d043f-d3c6-4fc9-ac4f-f78f9639ae72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5088256a8ec942d6bb07525d4215e379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:34:40Z,use_quota=True,user_id='eb9e6af1624040f7aa28297bc25663b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Creating volume e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:34:40 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:40 devstack quobyte-client[80089]: System call "ioctl" of process 84983 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:34:40 devstack quobyte-client[80089]: System call "open" of process 84983 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:34:40 devstack quobyte-client[80089]: System call "ioctl" of process 84983 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:34:40 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=25, name=volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 1073741824" returned: 0 in 0.121s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] <== create_volume: return (147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.149s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1b55c2-34f2-4567-bd16-1ad777027454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ab612d-f011-434b-9595-1bd7740d033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:40 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 (e84d043f-d3c6-4fc9-ac4f-f78f9639ae72): created successfully
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ab612d-f011-434b-9595-1bd7740d033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Flow 'volume_create_manager' (8019dc54-2ace-460f-ad68-3b16c6c9034b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:34:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-92a5faaf-5c3c-443a-922c-c2480ab731e2 tempest-AttachSCSIVolumeTestJSON-864875031 None] Created volume successfully.
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d3aa33-3792-4e4d-9eb6-fb5745dc136b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" returned: 0 in 0.225s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.234s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93314847-1c0f-4725-80a0-f513af8f80ee', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:34:44 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-98946f92-01bc-4066-b1bc-69bc3cd74c3e req-d7227c0e-47d9-4c7d-9a9f-e4f576f2c5b8 tempest-AttachSCSIVolumeTestJSON-864875031 None] attachment_update completed successfully.
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "cinder-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:44 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "cinder-quobyte-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-quobyte-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84d4a4-7666-48d7-8bad-b8d815a9549a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" returned: 0 in 0.174s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" returned: 0 in 0.060s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:44 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-quobyte-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9" released by "delete_volume" :: held 0.253s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Created reservations ['6307bc01-2ff4-44b8-bc1d-17bfe7fa228b', '2ef206eb-8a11-4582-8033-339624d1a5fb', 'a9f27430-fb3f-4946-b252-c000b35e473d', 'c7ad8f3d-7cea-4dcd-bcee-853a63675437'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:34:45 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Deleted volume successfully.
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a002eb6d-c96a-46f9-b313-e062db7bdb51 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-d107d2cd-2c52-4fbd-8170-c5578b7b5dc9-delete_volume" released by "delete_volume" :: held 0.405s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "cinder-77dc3741-ddc2-4f10-8d9b-41ef8243237a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-77dc3741-ddc2-4f10-8d9b-41ef8243237a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:45 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "cinder-quobyte-77dc3741-ddc2-4f10-8d9b-41ef8243237a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:34:45 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-quobyte-77dc3741-ddc2-4f10-8d9b-41ef8243237a" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e74e96-5a99-4f62-ba12-cbb3325c7ca7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:46 devstack quobyte-client[80089]: System call "getattr" of process 85402 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:34:46 devstack quobyte-client[80089]: System call "open" of process 85402 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a" returned: 0 in 0.217s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-77dc3741-ddc2-4f10-8d9b-41ef8243237a" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-quobyte-77dc3741-ddc2-4f10-8d9b-41ef8243237a" released by "delete_volume" :: held 0.287s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Created reservations ['e00d0278-88cc-4a0a-b5d7-4b884e2fa063', '011f42bc-c79b-4a19-b3a6-dce9ddea7e61', '492a5e1a-5ada-4f17-a2c9-2c2802cee206', '651d70d1-65a1-4e25-a531-e34cb60b3174'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:34:46 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Deleted volume successfully.
Sep 30 15:34:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c8d46c6d-1601-4698-9495-dbdaa9398227 tempest-TestServerVolumeAttachmentScenario-2124322165 None] Lock "cinder-77dc3741-ddc2-4f10-8d9b-41ef8243237a-delete_volume" released by "delete_volume" :: held 0.532s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:34:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:56 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=5 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:34:56 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:34:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Flow 'volume_create_manager' (95386dc6-69a9-4f5d-8566-8a7b3c3ebe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca661107-c965-4d9b-b050-5b708452de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca661107-c965-4d9b-b050-5b708452de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842e4aa5-9341-4661-9141-d14dc8e3518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac0d5dcc89844cea86f1ea3525530c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:34:58Z,use_quota=True,user_id='808582233aaf426d87013c6df1f45e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8bc51e-bb29-4bd8-a5fb-3976ecd264d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8bc51e-bb29-4bd8-a5fb-3976ecd264d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2f337d-07fa-487f-a61e-72a1c31c6672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2f337d-07fa-487f-a61e-72a1c31c6672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '842e4aa5-9341-4661-9141-d14dc8e3518e', 'volume_name': 'volume-842e4aa5-9341-4661-9141-d14dc8e3518e', 'volume_size': 1, 'image_id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01bbe213-a364-481d-92f8-8545d88d9ddf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df5b6f906160e461600f3e7a4a8b7c6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ac0d5dcc89844cea86f1ea3525530c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '060fe11390b6780fdf5a7d5716e43db3d938dcd96d6a8a65dcd3ab777cd9f2fa3c8ed2380d1aa16eb4612f8fb59012b5534fa659d2524e81708c071370d246bc', 'id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'created_at': datetime.datetime(2025, 9, 30, 13, 34, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01bbe213-a364-481d-92f8-8545d88d9ddf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423b544c0>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a79e454-3c64-4282-b9e7-67d2a8a31872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a79e454-3c64-4282-b9e7-67d2a8a31872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0922ce-f3a2-405a-a2a5-9dd722e17078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:34:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Volume 842e4aa5-9341-4661-9141-d14dc8e3518e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-842e4aa5-9341-4661-9141-d14dc8e3518e', 'volume_size': 1, 'image_id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01bbe213-a364-481d-92f8-8545d88d9ddf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df5b6f906160e461600f3e7a4a8b7c6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ac0d5dcc89844cea86f1ea3525530c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '060fe11390b6780fdf5a7d5716e43db3d938dcd96d6a8a65dcd3ab777cd9f2fa3c8ed2380d1aa16eb4612f8fb59012b5534fa659d2524e81708c071370d246bc', 'id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'created_at': datetime.datetime(2025, 9, 30, 13, 34, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01bbe213-a364-481d-92f8-8545d88d9ddf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423b544c0>}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Cloning 842e4aa5-9341-4661-9141-d14dc8e3518e from image 01bbe213-a364-481d-92f8-8545d88d9ddf  at location (None, [{'url': 'file:///opt/stack/data/glance/images/01bbe213-a364-481d-92f8-8545d88d9ddf', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:34:58 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4f4f9-a0c8-4656-907c-898bac0cff2f]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:58 devstack sudo[85567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD
Sep 30 15:34:58 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:34:59 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:34:59 devstack sudo[85571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD
Sep 30 15:34:59 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:34:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:34:59 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD" returned: 1 in 0.536s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Temporary image 01bbe213-a364-481d-92f8-8545d88d9ddf is fetched for user 808582233aaf426d87013c6df1f45e4f. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e15b703-3f2c-4028-8a25-7d7b15d84713]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:34:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:00 devstack sudo[85576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD
Sep 30 15:35:00 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:00 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD" returned: 0 in 0.593s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:00 devstack sudo[85580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD
Sep 30 15:35:00 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:01 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD" returned: 1 in 0.532s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842e4aa5-9341-4661-9141-d14dc8e3518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac0d5dcc89844cea86f1ea3525530c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:34:58Z,use_quota=True,user_id='808582233aaf426d87013c6df1f45e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Creating volume 842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:35:01 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:01 devstack quobyte-client[80089]: System call "lookup" of process 85585 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:35:01 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=26, name=volume-842e4aa5-9341-4661-9141-d14dc8e3518e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e 1073741824" returned: 0 in 0.134s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] <== create_volume: return (161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.163s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Attempting download of 01bbe213-a364-481d-92f8-8545d88d9ddf ((None, [{'url': 'file:///opt/stack/data/glance/images/01bbe213-a364-481d-92f8-8545d88d9ddf', 'metadata': {}}])) to volume 842e4aa5-9341-4661-9141-d14dc8e3518e. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76990a3-4305-4383-a8c2-fc5db23d51a5]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:01 devstack sudo[85589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j
Sep 30 15:35:01 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:01 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j" returned: 0 in 0.564s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:01 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j
Sep 30 15:35:01 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:02 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j" returned: 1 in 0.543s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01bbe213-a364-481d-92f8-8545d88d9ddf_v0tfoe8j' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:35:02 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[50708863-4076-4714-b430-a2285e0f2a16]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:35:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:02 devstack sudo[85598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD
Sep 30 15:35:02 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:03 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD" returned: 0 in 0.573s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:03 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD
Sep 30 15:35:03 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:03 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD" returned: 1 in 0.521s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:35:03 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] 01bbe213-a364-481d-92f8-8545d88d9ddf was raw, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:35:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:03 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e
Sep 30 15:35:03 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:35:03 devstack quobyte-client[80089]: System call "getattr" of process 85609 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:35:03 devstack quobyte-client[80089]: System call "open" of process 85609 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:35:04 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e" returned: 0 in 0.518s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01bbe213-a364-481d-92f8-8545d88d9ddf_00g8d7l2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:35:04 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ceff3-76d8-47be-b5c3-6c155825a43e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e" returned: 0 in 0.126s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e 1G" returned: 0 in 0.041s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Downloaded image 01bbe213-a364-481d-92f8-8545d88d9ddf ((None, [{'url': 'file:///opt/stack/data/glance/images/01bbe213-a364-481d-92f8-8545d88d9ddf', 'metadata': {}}])) to volume 842e4aa5-9341-4661-9141-d14dc8e3518e successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Temporary image 01bbe213-a364-481d-92f8-8545d88d9ddf for user 808582233aaf426d87013c6df1f45e4f is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Marking volume 842e4aa5-9341-4661-9141-d14dc8e3518e as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Copying metadata from image 01bbe213-a364-481d-92f8-8545d88d9ddf to 842e4aa5-9341-4661-9141-d14dc8e3518e. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Creating volume glance metadata for volume 842e4aa5-9341-4661-9141-d14dc8e3518e backed by image 01bbe213-a364-481d-92f8-8545d88d9ddf with: {'image_id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'df5b6f906160e461600f3e7a4a8b7c6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0922ce-f3a2-405a-a2a5-9dd722e17078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842e4aa5-9341-4661-9141-d14dc8e3518e', 'volume_size': 1, 'image_id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01bbe213-a364-481d-92f8-8545d88d9ddf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df5b6f906160e461600f3e7a4a8b7c6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ac0d5dcc89844cea86f1ea3525530c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '060fe11390b6780fdf5a7d5716e43db3d938dcd96d6a8a65dcd3ab777cd9f2fa3c8ed2380d1aa16eb4612f8fb59012b5534fa659d2524e81708c071370d246bc', 'id': '01bbe213-a364-481d-92f8-8545d88d9ddf', 'created_at': datetime.datetime(2025, 9, 30, 13, 34, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01bbe213-a364-481d-92f8-8545d88d9ddf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423b544c0>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d003b2e-802c-4d73-b300-52fc6432d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:04 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Volume volume-842e4aa5-9341-4661-9141-d14dc8e3518e (842e4aa5-9341-4661-9141-d14dc8e3518e): created successfully
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d003b2e-802c-4d73-b300-52fc6432d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Flow 'volume_create_manager' (95386dc6-69a9-4f5d-8566-8a7b3c3ebe3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:35:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-52391ec5-6bb8-4c9d-ba34-4232fdf16042 tempest-VolumeImageDependencyTests-1834427202 None] Created volume successfully.
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Acquiring lock "cinder-842e4aa5-9341-4661-9141-d14dc8e3518e-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Lock "cinder-842e4aa5-9341-4661-9141-d14dc8e3518e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:35:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Acquiring lock "cinder-quobyte-842e4aa5-9341-4661-9141-d14dc8e3518e" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Lock "cinder-quobyte-842e4aa5-9341-4661-9141-d14dc8e3518e" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae028d8-473c-405e-871e-f2fa6b133f15]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:35:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e" returned: 0 in 0.127s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-842e4aa5-9341-4661-9141-d14dc8e3518e" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Lock "cinder-quobyte-842e4aa5-9341-4661-9141-d14dc8e3518e" released by "delete_volume" :: held 0.169s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Created reservations ['b95b0781-f327-4398-aa4c-19aef827e1c2', 'd613f9fd-cbc0-4a06-9e6e-8c095d96e61a', 'db92f746-e7d7-43c2-a5e8-aafd1985e7c9', '4a33ec5a-9635-4b9b-8a14-700f664f862e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.015s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:35:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Deleted volume successfully.
Sep 30 15:35:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e12d1db3-d9c5-4dcf-928f-7803a4fd0a39 tempest-VolumeImageDependencyTests-1834427202 None] Lock "cinder-842e4aa5-9341-4661-9141-d14dc8e3518e-delete_volume" released by "delete_volume" :: held 0.329s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:35:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-70a56010-a811-49bd-a5f0-307ac87cfb48 req-ced5fa73-0ae8-40c2-bd71-a0182b22deb5 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-70a56010-a811-49bd-a5f0-307ac87cfb48 req-ced5fa73-0ae8-40c2-bd71-a0182b22deb5 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-70a56010-a811-49bd-a5f0-307ac87cfb48 req-ced5fa73-0ae8-40c2-bd71-a0182b22deb5 tempest-AttachSCSIVolumeTestJSON-864875031 None] Terminate volume connection completed successfully.
Sep 30 15:35:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-70a56010-a811-49bd-a5f0-307ac87cfb48 req-ced5fa73-0ae8-40c2-bd71-a0182b22deb5 tempest-AttachSCSIVolumeTestJSON-864875031 None] Deleting attachment 93314847-1c0f-4725-80a0-f513af8f80ee. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:35:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Acquiring lock "cinder-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "cinder-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:35:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Acquiring lock "cinder-quobyte-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "cinder-quobyte-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" acquired by "delete_volume" :: waited 0.005s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c26b86-5267-427c-9a47-e0d180308a0b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:20 devstack quobyte-client[80089]: System call "statfs" of process 85761 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" returned: 0 in 0.165s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "cinder-quobyte-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72" released by "delete_volume" :: held 0.244s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Created reservations ['00744fd6-29fe-44d4-b217-fd03d90ae3a0', '33d5155c-8004-4bfa-9087-6d141e87aaef', 'fe6484f9-f750-4032-bafa-963792755e1c', '2d47e187-142f-4b7a-818e-7d162f820130'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:35:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Deleted volume successfully.
Sep 30 15:35:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27fa2fbb-3199-4020-a316-336085990396 tempest-AttachSCSIVolumeTestJSON-864875031 None] Lock "cinder-e84d043f-d3c6-4fc9-ac4f-f78f9639ae72-delete_volume" released by "delete_volume" :: held 0.398s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:35:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:30 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:35:30 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:35:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:35:42 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Flow 'volume_create_manager' (926f29b0-e460-4163-b0c5-1f5ff0ef85b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f616bd2-bf66-43b7-a861-483c68c5a775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f616bd2-bf66-43b7-a861-483c68c5a775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1283943027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e285f9a-3625-4d09-b9a2-872e969db0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8fb5e4d493c45be8f4db18f0b8d221a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:35:42Z,use_quota=True,user_id='4f64ba95abfe46068491ba15858e0c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d2cb17-637b-4314-9fe5-9d2ebd72a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d2cb17-637b-4314-9fe5-9d2ebd72a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc68b0a8-b714-451b-81c9-38d6148ac1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc68b0a8-b714-451b-81c9-38d6148ac1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e285f9a-3625-4d09-b9a2-872e969db0c6', 'volume_name': 'volume-1e285f9a-3625-4d09-b9a2-872e969db0c6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64f24cf-21e9-4f9f-ac6b-fc7dcebb6b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64f24cf-21e9-4f9f-ac6b-fc7dcebb6b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310240a3-be90-4805-8772-35a5db720bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:42 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume 1e285f9a-3625-4d09-b9a2-872e969db0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e285f9a-3625-4d09-b9a2-872e969db0c6', 'volume_size': 1}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1283943027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e285f9a-3625-4d09-b9a2-872e969db0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8fb5e4d493c45be8f4db18f0b8d221a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:35:42Z,use_quota=True,user_id='4f64ba95abfe46068491ba15858e0c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Creating volume 1e285f9a-3625-4d09-b9a2-872e969db0c6 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:35:42 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:42 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=27, name=volume-1e285f9a-3625-4d09-b9a2-872e969db0c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6 1073741824" returned: 0 in 0.116s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] <== create_volume: return (153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.155s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310240a3-be90-4805-8772-35a5db720bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e285f9a-3625-4d09-b9a2-872e969db0c6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db27f474-2404-47ff-a01b-443e55ce2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:35:42 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume volume-1e285f9a-3625-4d09-b9a2-872e969db0c6 (1e285f9a-3625-4d09-b9a2-872e969db0c6): created successfully
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db27f474-2404-47ff-a01b-443e55ce2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:35:42 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Flow 'volume_create_manager' (926f29b0-e460-4163-b0c5-1f5ff0ef85b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:35:42 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7383fc1a-930f-453b-b23b-72ba42b685e9 tempest-AttachVolumeShelveTestJSON-354420458 None] Created volume successfully.
Sep 30 15:35:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:52 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:35:52 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:35:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:35:57 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-2e603566-b105-4eae-a41c-a30254dd1f04 req-072164df-6e1c-411b-b9e5-d924d50e0400 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:57 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-2e603566-b105-4eae-a41c-a30254dd1f04 req-072164df-6e1c-411b-b9e5-d924d50e0400 tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:35:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-2e603566-b105-4eae-a41c-a30254dd1f04 req-072164df-6e1c-411b-b9e5-d924d50e0400 tempest-AttachVolumeShelveTestJSON-354420458 None] No connector for attachment 7a2ae134-ed36-41b6-8bff-c6609554e7f9; skipping storage backend terminate_connection call. {{(pid=80302) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 30 15:35:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-2e603566-b105-4eae-a41c-a30254dd1f04 req-072164df-6e1c-411b-b9e5-d924d50e0400 tempest-AttachVolumeShelveTestJSON-354420458 None] Deleting attachment 7a2ae134-ed36-41b6-8bff-c6609554e7f9. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:35:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Flow 'volume_create_manager' (21db947e-54f6-41e5-85de-145543ad6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a26911-81e3-4b26-8326-9fb796fe826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a26911-81e3-4b26-8326-9fb796fe826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1491854763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4164840e-9627-4f3a-8b35-ea5a6b4f8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1cbc8a58474a878d135b0e40371238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:36:00Z,use_quota=True,user_id='8b13974ed4764aecafc5ba63f6856882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd809ff-b082-426a-b615-0bd24b17e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd809ff-b082-426a-b615-0bd24b17e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073b4b97-acaa-4479-9a49-95f50963c340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073b4b97-acaa-4479-9a49-95f50963c340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4164840e-9627-4f3a-8b35-ea5a6b4f8d71', 'volume_name': 'volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0096c0e9-4fff-4ca4-be4f-4ab015cd6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0096c0e9-4fff-4ca4-be4f-4ab015cd6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c227dfa-1717-4f64-9176-c0f51a3a532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:00 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Volume 4164840e-9627-4f3a-8b35-ea5a6b4f8d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71', 'volume_size': 1}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1491854763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4164840e-9627-4f3a-8b35-ea5a6b4f8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1cbc8a58474a878d135b0e40371238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:36:00Z,use_quota=True,user_id='8b13974ed4764aecafc5ba63f6856882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Creating volume 4164840e-9627-4f3a-8b35-ea5a6b4f8d71 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:36:00 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:00 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=28, name=volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 1073741824" returned: 0 in 0.112s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] <== create_volume: return (136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.138s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c227dfa-1717-4f64-9176-c0f51a3a532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249dbab-099d-431e-91f2-d85dbbd5ab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:00 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Volume volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 (4164840e-9627-4f3a-8b35-ea5a6b4f8d71): created successfully
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249dbab-099d-431e-91f2-d85dbbd5ab80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Flow 'volume_create_manager' (21db947e-54f6-41e5-85de-145543ad6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:36:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4a7f7b4e-052c-49fb-bad4-7488af9d0e3b tempest-AttachVolumeNegativeTest-1425499349 None] Created volume successfully.
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5600d2-cf81-4e1e-bf39-38bd2da485a4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" returned: 0 in 0.168s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.183s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcb5c946-72da-402c-8788-153fad1363e1', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:36:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:36:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-c963f66b-e185-4e6a-9fb6-a0a7505f4eb9 req-f3a49e41-2b6a-45bb-8187-73b0a455d06c tempest-AttachVolumeNegativeTest-1425499349 None] attachment_update completed successfully.
Sep 30 15:36:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Flow 'volume_create_manager' (78e7c1d6-54ba-4505-a632-4959197b9dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d951e0e-97f7-4712-a215-41dfe2bb1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d951e0e-97f7-4712-a215-41dfe2bb1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1867500664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b98dcf-2560-4f85-9b06-4d53a3b68564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4171fb0713384b0394dbd03bda166175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:36:05Z,use_quota=True,user_id='a3f3e767483342e9a3e99e9694a05866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad0dc60-3ab6-4f26-8cc8-0d2a8c312ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad0dc60-3ab6-4f26-8cc8-0d2a8c312ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5e18e8-44e6-48f5-92a0-7505c2daccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5e18e8-44e6-48f5-92a0-7505c2daccf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b98dcf-2560-4f85-9b06-4d53a3b68564', 'volume_name': 'volume-13b98dcf-2560-4f85-9b06-4d53a3b68564', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab0698a-1466-4580-8b72-223a378845a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab0698a-1466-4580-8b72-223a378845a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46292f7a-0f65-435e-9a51-c8f011490a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:05 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Volume 13b98dcf-2560-4f85-9b06-4d53a3b68564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b98dcf-2560-4f85-9b06-4d53a3b68564', 'volume_size': 1}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1867500664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b98dcf-2560-4f85-9b06-4d53a3b68564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4171fb0713384b0394dbd03bda166175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:36:05Z,use_quota=True,user_id='a3f3e767483342e9a3e99e9694a05866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Creating volume 13b98dcf-2560-4f85-9b06-4d53a3b68564 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:36:05 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:05 devstack quobyte-client[80089]: System call "getattr" of process 86118 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:05 devstack quobyte-client[80089]: System call "lookup" of process 86118 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:05 devstack quobyte-client[80089]: System call "create" of process 86118 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:05 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=29, name=volume-13b98dcf-2560-4f85-9b06-4d53a3b68564, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564 1073741824" returned: 0 in 0.170s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] <== create_volume: return (197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.199s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46292f7a-0f65-435e-9a51-c8f011490a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b98dcf-2560-4f85-9b06-4d53a3b68564', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e0606f-39b9-4d80-b94f-577a76035b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:05 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Volume volume-13b98dcf-2560-4f85-9b06-4d53a3b68564 (13b98dcf-2560-4f85-9b06-4d53a3b68564): created successfully
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e0606f-39b9-4d80-b94f-577a76035b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Flow 'volume_create_manager' (78e7c1d6-54ba-4505-a632-4959197b9dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:36:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6e5bc672-9fa7-4bfa-b9ac-d17c68136a33 tempest-VolumesAdminNegativeTest-2010610293 None] Created volume successfully.
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Acquiring lock "cinder-13b98dcf-2560-4f85-9b06-4d53a3b68564-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Lock "cinder-13b98dcf-2560-4f85-9b06-4d53a3b68564-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:36:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Acquiring lock "cinder-quobyte-13b98dcf-2560-4f85-9b06-4d53a3b68564" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Lock "cinder-quobyte-13b98dcf-2560-4f85-9b06-4d53a3b68564" acquired by "delete_volume" :: waited 0.024s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b341ff-6519-45db-87a6-e5344532af6d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564" returned: 0 in 0.265s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-13b98dcf-2560-4f85-9b06-4d53a3b68564" returned: 0 in 0.049s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Lock "cinder-quobyte-13b98dcf-2560-4f85-9b06-4d53a3b68564" released by "delete_volume" :: held 0.343s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Created reservations ['a7dd9aa9-94a6-4bec-a843-1abe520bde65', 'c404bfdf-e2cf-471c-a9ec-647a32623696', 'f3f10dbe-08b5-4840-b1b0-633ff2e083ad', '4c03e77f-17bc-48ea-9fa1-c4e04edffd1d'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.045s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:36:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Deleted volume successfully.
Sep 30 15:36:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66d35b50-bc94-4624-8886-9a02ae1e095c tempest-VolumesAdminNegativeTest-2010610293 None] Lock "cinder-13b98dcf-2560-4f85-9b06-4d53a3b68564-delete_volume" released by "delete_volume" :: held 0.654s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:36:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:16 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:36:16 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:36:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.048s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:36:41 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Flow 'volume_create_manager' (6ea74af5-dd97-46ad-a59e-57ebc05c4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76397af-9097-4bb7-aef9-df455313f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76397af-9097-4bb7-aef9-df455313f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-777054758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7494ea-ea3e-4a07-86ee-c642bbd076ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6a4a5b1df459fa482b456e39466cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:36:41Z,use_quota=True,user_id='efd8dc8cff9147678565f777f2eb5541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87568a93-f827-478f-abaa-501186416a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87568a93-f827-478f-abaa-501186416a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0658125e-6bc6-445a-a241-b1d912973cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0658125e-6bc6-445a-a241-b1d912973cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7494ea-ea3e-4a07-86ee-c642bbd076ee', 'volume_name': 'volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249ec6cc-3e99-493d-82dc-66f49b306c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249ec6cc-3e99-493d-82dc-66f49b306c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c8ad00-42ef-4b3c-87f1-a532dd8fc38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:41 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Volume bc7494ea-ea3e-4a07-86ee-c642bbd076ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee', 'volume_size': 1}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-777054758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7494ea-ea3e-4a07-86ee-c642bbd076ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6a4a5b1df459fa482b456e39466cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:36:41Z,use_quota=True,user_id='efd8dc8cff9147678565f777f2eb5541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Creating volume bc7494ea-ea3e-4a07-86ee-c642bbd076ee {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:36:41 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:41 devstack quobyte-client[80089]: System call "getattr" of process 86767 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:41 devstack quobyte-client[80089]: System call "getattr" of process 86767 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:41 devstack quobyte-client[80089]: System call "lookup" of process 86767 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:41 devstack quobyte-client[80089]: System call "create" of process 86767 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:41 devstack quobyte-client[80089]: System call "getattr" of process 86767 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:36:41 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=30, name=volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee 1073741824" returned: 0 in 0.204s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] <== create_volume: return (236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.238s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c8ad00-42ef-4b3c-87f1-a532dd8fc38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6e6fc6-99f7-4922-8dba-17048068c0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:36:41 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Volume volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee (bc7494ea-ea3e-4a07-86ee-c642bbd076ee): created successfully
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6e6fc6-99f7-4922-8dba-17048068c0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:36:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Flow 'volume_create_manager' (6ea74af5-dd97-46ad-a59e-57ebc05c4736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:36:41 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-88e174ca-048e-44eb-81a9-f25845e23922 tempest-TaggedAttachmentsTest-1801118099 None] Created volume successfully.
Sep 30 15:36:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:36:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:36:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:36:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "cinder-1e285f9a-3625-4d09-b9a2-872e969db0c6-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-1e285f9a-3625-4d09-b9a2-872e969db0c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:37:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "cinder-quobyte-1e285f9a-3625-4d09-b9a2-872e969db0c6" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-quobyte-1e285f9a-3625-4d09-b9a2-872e969db0c6" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6ee77-97b5-4dfa-a47b-a859d7e59db7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e285f9a-3625-4d09-b9a2-872e969db0c6" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-quobyte-1e285f9a-3625-4d09-b9a2-872e969db0c6" released by "delete_volume" :: held 0.197s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Created reservations ['a99164bd-a86a-4a98-b123-3fc66e25293b', '60e733f0-af77-4816-ae12-0fbcd4d72fcf', 'f145109a-8d6d-4252-84dd-cbd86f035722', 'd15e0b82-c61d-4be0-8a69-98a52ba48f0e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:37:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Deleted volume successfully.
Sep 30 15:37:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b435a271-61cd-45c4-b5ee-09fab244e08d tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-1e285f9a-3625-4d09-b9a2-872e969db0c6-delete_volume" released by "delete_volume" :: held 0.348s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "cinder-61d99eab-711b-4c44-ae6c-c9883b262de9-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-61d99eab-711b-4c44-ae6c-c9883b262de9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:37:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "cinder-quobyte-61d99eab-711b-4c44-ae6c-c9883b262de9" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-quobyte-61d99eab-711b-4c44-ae6c-c9883b262de9" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f80e6-97d6-4f4f-90a4-2f718e995f0a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-61d99eab-711b-4c44-ae6c-c9883b262de9" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-quobyte-61d99eab-711b-4c44-ae6c-c9883b262de9" released by "delete_volume" :: held 0.211s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Created reservations ['f1c05a61-d418-4741-8738-0af7496f4a34', '77505ad0-40da-4ac8-b372-4c02b3f43ca0', '29d46bbf-d37d-45a8-9a5c-88be6a734a9b', 'c724757b-2310-46d8-884f-b47efd7431a1'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:37:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Deleted volume successfully.
Sep 30 15:37:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0008e677-cc66-4632-855e-273ee889404b tempest-AttachVolumeShelveTestJSON-354420458 None] Lock "cinder-61d99eab-711b-4c44-ae6c-c9883b262de9-delete_volume" released by "delete_volume" :: held 0.340s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:37:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:37 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=20,cinder:SELECT=8,cinder:INSERT=4 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:37:37 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.041s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:37:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:37:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:37:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-94e0bc46-63cc-4876-9c79-bde800e157b8 req-1303c8a2-289f-4b09-b149-0c8a1c68ef92 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:38:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-94e0bc46-63cc-4876-9c79-bde800e157b8 req-1303c8a2-289f-4b09-b149-0c8a1c68ef92 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:38:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-94e0bc46-63cc-4876-9c79-bde800e157b8 req-1303c8a2-289f-4b09-b149-0c8a1c68ef92 tempest-AttachVolumeNegativeTest-1425499349 None] Terminate volume connection completed successfully.
Sep 30 15:38:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-94e0bc46-63cc-4876-9c79-bde800e157b8 req-1303c8a2-289f-4b09-b149-0c8a1c68ef92 tempest-AttachVolumeNegativeTest-1425499349 None] Deleting attachment fcb5c946-72da-402c-8788-153fad1363e1. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:38:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:10 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:10 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9f7d7d-e5a9-405d-ace3-c04eddc52563]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" returned: 0 in 0.164s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.174s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:38:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5de1b12-c7b5-4252-96c8-28761364bfcd', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:38:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:38:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-15b7f1ce-3017-4d91-abc5-80681a4d7245 req-0580dc79-8ae7-4ea0-82af-6558252e981f tempest-TaggedAttachmentsTest-1801118099 None] attachment_update completed successfully.
Sep 30 15:38:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:28 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:28 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=8 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.038s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:38:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:38:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:47 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-f9754ce6-6daf-4433-a6cf-a6f145375f22 req-13c38db5-19b8-499f-bac4-2291e30dafe2 tempest-TaggedAttachmentsTest-1801118099 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:38:47 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-f9754ce6-6daf-4433-a6cf-a6f145375f22 req-13c38db5-19b8-499f-bac4-2291e30dafe2 tempest-TaggedAttachmentsTest-1801118099 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:38:47 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-f9754ce6-6daf-4433-a6cf-a6f145375f22 req-13c38db5-19b8-499f-bac4-2291e30dafe2 tempest-TaggedAttachmentsTest-1801118099 None] Terminate volume connection completed successfully.
Sep 30 15:38:47 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-f9754ce6-6daf-4433-a6cf-a6f145375f22 req-13c38db5-19b8-499f-bac4-2291e30dafe2 tempest-TaggedAttachmentsTest-1801118099 None] Deleting attachment b5de1b12-c7b5-4252-96c8-28761364bfcd. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:38:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:38:57 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:57 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:38:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Flow 'volume_create_manager' (342fb2d4-746f-44a2-83d1-bfbb9ef36a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253dc49c-f5d2-4c23-9f27-f016890b9f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253dc49c-f5d2-4c23-9f27-f016890b9f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-644665840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9308c77a-7813-49f1-9c85-bf03ead8474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce52ef850324caf9d088e0f6462c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:39:02Z,use_quota=True,user_id='9b8bd0d0918b4ee0861a63f4d46f5af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd035d99-2ca2-431e-a97b-a20babb7c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd035d99-2ca2-431e-a97b-a20babb7c578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9be9ce-da7a-45ea-b5ad-e6ce171cee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9be9ce-da7a-45ea-b5ad-e6ce171cee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9308c77a-7813-49f1-9c85-bf03ead8474b', 'volume_name': 'volume-9308c77a-7813-49f1-9c85-bf03ead8474b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a353a146-a740-44fb-8184-c3147bfc56cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a353a146-a740-44fb-8184-c3147bfc56cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f497cf-873d-42f5-a9a3-17fe2664dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:02 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Volume 9308c77a-7813-49f1-9c85-bf03ead8474b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9308c77a-7813-49f1-9c85-bf03ead8474b', 'volume_size': 1}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-644665840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9308c77a-7813-49f1-9c85-bf03ead8474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce52ef850324caf9d088e0f6462c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:39:02Z,use_quota=True,user_id='9b8bd0d0918b4ee0861a63f4d46f5af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Creating volume 9308c77a-7813-49f1-9c85-bf03ead8474b {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:39:02 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:02 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=31, name=volume-9308c77a-7813-49f1-9c85-bf03ead8474b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b 1073741824" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] <== create_volume: return (156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.158s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f497cf-873d-42f5-a9a3-17fe2664dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9308c77a-7813-49f1-9c85-bf03ead8474b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb1348b-7985-422b-a92c-37dd0eafd15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:02 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Volume volume-9308c77a-7813-49f1-9c85-bf03ead8474b (9308c77a-7813-49f1-9c85-bf03ead8474b): created successfully
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb1348b-7985-422b-a92c-37dd0eafd15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Flow 'volume_create_manager' (342fb2d4-746f-44a2-83d1-bfbb9ef36a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:39:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7db0f573-14a1-4ac1-b137-5c35e9616abe tempest-AttachVolumeTestJSON-972140354 None] Created volume successfully.
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd4728-95af-45b2-9a1d-af708bd68281]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.169s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-9308c77a-7813-49f1-9c85-bf03ead8474b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '794d0b33-47b5-4fe6-be06-d9ee038ccb22', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:39:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:39:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-4beb842a-e10c-4ed2-a037-ac70b2f1b1a6 req-11765a00-7c25-4d59-8066-0b1837132489 tempest-AttachVolumeTestJSON-972140354 None] attachment_update completed successfully.
Sep 30 15:39:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:16 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:39:16 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:39:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Acquiring lock "cinder-bc7494ea-ea3e-4a07-86ee-c642bbd076ee-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Lock "cinder-bc7494ea-ea3e-4a07-86ee-c642bbd076ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:39:24 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Acquiring lock "cinder-quobyte-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Lock "cinder-quobyte-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0001287-e8e3-447f-bdbd-7e3089d7b337]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Lock "cinder-quobyte-bc7494ea-ea3e-4a07-86ee-c642bbd076ee" released by "delete_volume" :: held 0.179s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Created reservations ['42e41931-0fdd-4875-b01e-e293fbcebdb0', '37e851a8-2115-49b4-bfaa-7d22c1efba96', 'd12d2f2a-5e5d-4f33-837e-b6dc64fec87c', '5ed20caa-1ee7-4e18-a5c3-35d36adc97be'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:39:24 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Deleted volume successfully.
Sep 30 15:39:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-66b2086f-6fe5-429a-8567-b92525199ef1 tempest-TaggedAttachmentsTest-1801118099 None] Lock "cinder-bc7494ea-ea3e-4a07-86ee-c642bbd076ee-delete_volume" released by "delete_volume" :: held 0.331s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:39:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:30 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:39:30 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:39:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Flow 'volume_create_manager' (7e4a4d5b-419b-4593-8e7f-3a6e29eb4c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393a5a74-3b87-44ac-a3c5-fcbe1f151c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393a5a74-3b87-44ac-a3c5-fcbe1f151c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911250208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b162e8a-8373-4584-9c13-029479a6ee1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1cbc8a58474a878d135b0e40371238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:39:31Z,use_quota=True,user_id='8b13974ed4764aecafc5ba63f6856882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd583948-fe2f-40e7-8b76-b81b90f351e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd583948-fe2f-40e7-8b76-b81b90f351e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27061723-9089-4466-aa71-46a99e01ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27061723-9089-4466-aa71-46a99e01ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b162e8a-8373-4584-9c13-029479a6ee1a', 'volume_name': 'volume-0b162e8a-8373-4584-9c13-029479a6ee1a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1986a492-e93d-4539-b297-f36192c90b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1986a492-e93d-4539-b297-f36192c90b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e2992f-469f-476d-84c5-391b48537a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Volume 0b162e8a-8373-4584-9c13-029479a6ee1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b162e8a-8373-4584-9c13-029479a6ee1a', 'volume_size': 1}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911250208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b162e8a-8373-4584-9c13-029479a6ee1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1cbc8a58474a878d135b0e40371238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:39:31Z,use_quota=True,user_id='8b13974ed4764aecafc5ba63f6856882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Creating volume 0b162e8a-8373-4584-9c13-029479a6ee1a {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:39:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=32, name=volume-0b162e8a-8373-4584-9c13-029479a6ee1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a 1073741824" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] <== create_volume: return (176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.178s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e2992f-469f-476d-84c5-391b48537a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b162e8a-8373-4584-9c13-029479a6ee1a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7323a112-b2f9-4daa-afa5-25bc82aaa6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:39:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Volume volume-0b162e8a-8373-4584-9c13-029479a6ee1a (0b162e8a-8373-4584-9c13-029479a6ee1a): created successfully
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7323a112-b2f9-4daa-afa5-25bc82aaa6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:39:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Flow 'volume_create_manager' (7e4a4d5b-419b-4593-8e7f-3a6e29eb4c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:39:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2dc07c59-482f-4cd7-9773-4280d5552713 tempest-AttachVolumeNegativeTest-1425499349 None] Created volume successfully.
Sep 30 15:39:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1edf2-1482-4e9f-b777-92074f209d32]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:39:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.164s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-0b162e8a-8373-4584-9c13-029479a6ee1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0640df96-8878-4f78-85a9-e6e2bcc6f375', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:39:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:39:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-64b7bd6d-42b2-4994-b5f0-79203d084bc8 req-52535118-2e77-47dd-8a57-c4e997ba816f tempest-AttachVolumeNegativeTest-1425499349 None] attachment_update completed successfully.
Sep 30 15:39:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:39:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:39:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=16,cinder:SELECT=10,cinder:INSERT=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:39:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:39:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:39:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-f7551423-59e4-41c8-8f5c-25b12767bcce req-d10a8a6e-283d-4e85-869b-5fe5c8930805 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-f7551423-59e4-41c8-8f5c-25b12767bcce req-d10a8a6e-283d-4e85-869b-5fe5c8930805 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-f7551423-59e4-41c8-8f5c-25b12767bcce req-d10a8a6e-283d-4e85-869b-5fe5c8930805 tempest-AttachVolumeNegativeTest-1425499349 None] Terminate volume connection completed successfully.
Sep 30 15:40:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-f7551423-59e4-41c8-8f5c-25b12767bcce req-d10a8a6e-283d-4e85-869b-5fe5c8930805 tempest-AttachVolumeNegativeTest-1425499349 None] Deleting attachment 0640df96-8878-4f78-85a9-e6e2bcc6f375. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:40:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:12 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:40:12 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:40:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Flow 'volume_create_manager' (27516bc7-963a-4cab-9ff7-2ac30acd470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d684c4-4e26-4017-8a52-2e5fa9a26413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d684c4-4e26-4017-8a52-2e5fa9a26413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945799867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82d151a-bb21-4891-ab16-de2788defd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5277aef25e8a4498bf81fb8d8214a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:16Z,use_quota=True,user_id='ccd0430733764fc5aa239c0607abfcd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9452154c-c538-4efc-8056-c0b4036ff4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9452154c-c538-4efc-8056-c0b4036ff4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4b6e55-5d92-40ba-8688-0ea49c360a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4b6e55-5d92-40ba-8688-0ea49c360a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82d151a-bb21-4891-ab16-de2788defd62', 'volume_name': 'volume-a82d151a-bb21-4891-ab16-de2788defd62', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00398848-5582-46e0-9812-64f8d3e76384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00398848-5582-46e0-9812-64f8d3e76384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e5b70f-8d3e-428d-a7b1-615a2d65b345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Volume a82d151a-bb21-4891-ab16-de2788defd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82d151a-bb21-4891-ab16-de2788defd62', 'volume_size': 1}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945799867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82d151a-bb21-4891-ab16-de2788defd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5277aef25e8a4498bf81fb8d8214a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:16Z,use_quota=True,user_id='ccd0430733764fc5aa239c0607abfcd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Creating volume a82d151a-bb21-4891-ab16-de2788defd62 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:16 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:16 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=33, name=volume-a82d151a-bb21-4891-ab16-de2788defd62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62 1073741824" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] <== create_volume: return (178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.180s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e5b70f-8d3e-428d-a7b1-615a2d65b345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82d151a-bb21-4891-ab16-de2788defd62', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b644aca-6f75-426d-963f-35d75120857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Volume volume-a82d151a-bb21-4891-ab16-de2788defd62 (a82d151a-bb21-4891-ab16-de2788defd62): created successfully
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b644aca-6f75-426d-963f-35d75120857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Flow 'volume_create_manager' (27516bc7-963a-4cab-9ff7-2ac30acd470a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-47fe0526-d981-4d98-946f-69043395d325 tempest-ServersNegativeTestJSON-611022379 None] Created volume successfully.
Sep 30 15:40:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Flow 'volume_create_manager' (133b0b80-1266-4f41-98ff-53d359719f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc353ee-a3bb-44e1-939d-896c3e3331bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc353ee-a3bb-44e1-939d-896c3e3331bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1566986788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aafbe5-a8fe-4c92-a271-ed78f7770625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5277aef25e8a4498bf81fb8d8214a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:18Z,use_quota=True,user_id='ccd0430733764fc5aa239c0607abfcd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39597aa9-9fb0-4d53-8dcf-dd218a945eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39597aa9-9fb0-4d53-8dcf-dd218a945eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5584730-d67f-4b49-8ad4-79c9f735fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5584730-d67f-4b49-8ad4-79c9f735fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81aafbe5-a8fe-4c92-a271-ed78f7770625', 'volume_name': 'volume-81aafbe5-a8fe-4c92-a271-ed78f7770625', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e97495-d390-4892-bfdc-5874d9699c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e97495-d390-4892-bfdc-5874d9699c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6534675-c6c7-4c3a-aedf-f8e7800890b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Volume 81aafbe5-a8fe-4c92-a271-ed78f7770625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81aafbe5-a8fe-4c92-a271-ed78f7770625', 'volume_size': 1}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1566986788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aafbe5-a8fe-4c92-a271-ed78f7770625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5277aef25e8a4498bf81fb8d8214a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:18Z,use_quota=True,user_id='ccd0430733764fc5aa239c0607abfcd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Creating volume 81aafbe5-a8fe-4c92-a271-ed78f7770625 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:18 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:18 devstack quobyte-client[80089]: System call "getlk" of process 89464 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:18 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=34, name=volume-81aafbe5-a8fe-4c92-a271-ed78f7770625, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625 1073741824" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] <== create_volume: return (155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.157s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6534675-c6c7-4c3a-aedf-f8e7800890b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81aafbe5-a8fe-4c92-a271-ed78f7770625', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ed7a7c-b3e6-484a-9576-4cb641da0784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Volume volume-81aafbe5-a8fe-4c92-a271-ed78f7770625 (81aafbe5-a8fe-4c92-a271-ed78f7770625): created successfully
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ed7a7c-b3e6-484a-9576-4cb641da0784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Flow 'volume_create_manager' (133b0b80-1266-4f41-98ff-53d359719f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4a78b24b-3989-43aa-ae3b-6dbef89f2691 tempest-ServersNegativeTestJSON-611022379 None] Created volume successfully.
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "cinder-81aafbe5-a8fe-4c92-a271-ed78f7770625-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-81aafbe5-a8fe-4c92-a271-ed78f7770625-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "cinder-quobyte-81aafbe5-a8fe-4c92-a271-ed78f7770625" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-quobyte-81aafbe5-a8fe-4c92-a271-ed78f7770625" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[75acba2d-d27e-4e2e-9cb5-1cda424fdf1b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625" returned: 0 in 0.197s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-81aafbe5-a8fe-4c92-a271-ed78f7770625" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-quobyte-81aafbe5-a8fe-4c92-a271-ed78f7770625" released by "delete_volume" :: held 0.251s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:19 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Created reservations ['dfddfedf-335b-495c-99ed-213336bb0b9f', '554a641c-7061-4374-a224-7bac329668bb', '903ff597-dcd7-4394-a70d-81d55e041931', 'e174a388-376d-4bbe-a691-bb7aab41ee72'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Deleted volume successfully.
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-330928c4-2d58-414d-926a-771a572a7854 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-81aafbe5-a8fe-4c92-a271-ed78f7770625-delete_volume" released by "delete_volume" :: held 0.433s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "cinder-a82d151a-bb21-4891-ab16-de2788defd62-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-a82d151a-bb21-4891-ab16-de2788defd62-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "cinder-quobyte-a82d151a-bb21-4891-ab16-de2788defd62" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-quobyte-a82d151a-bb21-4891-ab16-de2788defd62" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e340d9c-cbe2-4932-9127-9b466c3dc52b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62" returned: 0 in 0.167s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a82d151a-bb21-4891-ab16-de2788defd62" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-quobyte-a82d151a-bb21-4891-ab16-de2788defd62" released by "delete_volume" :: held 0.221s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Created reservations ['d95fbff2-44b6-4e3f-8bcb-11779df7bde7', '58c12055-f30f-4857-ae8c-b745b7d673fd', '428efa7b-d250-4662-a4fe-ac8b041bf608', '19be5366-abc5-4007-9e99-6ba91fd06f98'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Deleted volume successfully.
Sep 30 15:40:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-81b07974-2324-45ec-bb38-933b64185768 tempest-ServersNegativeTestJSON-611022379 None] Lock "cinder-a82d151a-bb21-4891-ab16-de2788defd62-delete_volume" released by "delete_volume" :: held 0.416s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:31 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=14,cinder:UPDATE=26,cinder:INSERT=4 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:40:31 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=14,cinder:DELETE=4,cinder:SELECT=10,cinder:INSERT=4 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:40:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:32 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Flow 'volume_create_manager' (33a396b1-9d8f-4c35-a5f4-19d596ce66b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2fc241-df43-4868-b656-005a880d9cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2fc241-df43-4868-b656-005a880d9cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548199511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467d2e3a-e799-4bb6-9234-344e97fbfe14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e83cd82ea924658a6089f3a9ce71dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:33Z,use_quota=True,user_id='adcb144b1a5e4369a1ce56a88067c08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f29d37f-6d52-459b-9b32-093eacf7607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f29d37f-6d52-459b-9b32-093eacf7607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b79d920-efcb-42c0-87f8-1469d4cd4616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b79d920-efcb-42c0-87f8-1469d4cd4616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467d2e3a-e799-4bb6-9234-344e97fbfe14', 'volume_name': 'volume-467d2e3a-e799-4bb6-9234-344e97fbfe14', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df2325d-661d-4e15-9725-351e5596ddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df2325d-661d-4e15-9725-351e5596ddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57019d8d-8123-4389-a42a-fcc53ce0b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:33 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Volume 467d2e3a-e799-4bb6-9234-344e97fbfe14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467d2e3a-e799-4bb6-9234-344e97fbfe14', 'volume_size': 1}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548199511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467d2e3a-e799-4bb6-9234-344e97fbfe14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e83cd82ea924658a6089f3a9ce71dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:33Z,use_quota=True,user_id='adcb144b1a5e4369a1ce56a88067c08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Creating volume 467d2e3a-e799-4bb6-9234-344e97fbfe14 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:33 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:33 devstack quobyte-client[80089]: System call "getattr" of process 89636 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:33 devstack quobyte-client[80089]: System call "lookup" of process 89636 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:33 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=35, name=volume-467d2e3a-e799-4bb6-9234-344e97fbfe14, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14 1073741824" returned: 0 in 0.138s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] <== create_volume: return (182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.184s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57019d8d-8123-4389-a42a-fcc53ce0b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467d2e3a-e799-4bb6-9234-344e97fbfe14', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7154ac18-db5d-4f95-bcdf-9046e44f6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:33 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Volume volume-467d2e3a-e799-4bb6-9234-344e97fbfe14 (467d2e3a-e799-4bb6-9234-344e97fbfe14): created successfully
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7154ac18-db5d-4f95-bcdf-9046e44f6528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Flow 'volume_create_manager' (33a396b1-9d8f-4c35-a5f4-19d596ce66b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-71115edf-b386-4af7-a00b-87998095cd0b tempest-VolumesTestJSON-56975074 None] Created volume successfully.
Sep 30 15:40:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Flow 'volume_create_manager' (44d2f526-594c-471d-bb29-c6a0e55d1502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1370d3a-97a5-439e-a743-b2c9e25253cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1370d3a-97a5-439e-a743-b2c9e25253cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1693176526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c109c-da09-46c6-b8a2-1fd5698a576a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e83cd82ea924658a6089f3a9ce71dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:34Z,use_quota=True,user_id='adcb144b1a5e4369a1ce56a88067c08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0475ab-2cee-4710-a92c-96c4165e13c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0475ab-2cee-4710-a92c-96c4165e13c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefc4fb5-7273-4074-b28a-5e25ba6f61d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefc4fb5-7273-4074-b28a-5e25ba6f61d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5c109c-da09-46c6-b8a2-1fd5698a576a', 'volume_name': 'volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792ad3c4-0dd2-4b35-9181-0c04d86ace1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792ad3c4-0dd2-4b35-9181-0c04d86ace1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e78692-0f78-4a0d-a37c-e81d672c639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:34 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Volume 1e5c109c-da09-46c6-b8a2-1fd5698a576a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a', 'volume_size': 1}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1693176526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c109c-da09-46c6-b8a2-1fd5698a576a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e83cd82ea924658a6089f3a9ce71dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:34Z,use_quota=True,user_id='adcb144b1a5e4369a1ce56a88067c08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Creating volume 1e5c109c-da09-46c6-b8a2-1fd5698a576a {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:34 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:34 devstack quobyte-client[80089]: System call "ioctl" of process 89644 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:34 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=36, name=volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a 1073741824" returned: 0 in 0.106s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] <== create_volume: return (132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.134s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e78692-0f78-4a0d-a37c-e81d672c639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b5090e-6b06-47db-ae47-f9b41eb91b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:34 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Volume volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a (1e5c109c-da09-46c6-b8a2-1fd5698a576a): created successfully
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b5090e-6b06-47db-ae47-f9b41eb91b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Flow 'volume_create_manager' (44d2f526-594c-471d-bb29-c6a0e55d1502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e489ad0e-1b18-4ce9-be5d-039fe526056b tempest-VolumesTestJSON-56975074 None] Created volume successfully.
Sep 30 15:40:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Flow 'volume_create_manager' (14475cbf-4625-4c47-8ffa-af4cbb9d178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b245dee7-5da8-43d2-8d8f-c72138d9682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b245dee7-5da8-43d2-8d8f-c72138d9682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550915761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571ee401-db22-4f67-bf56-54f8e3d16ef5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e83cd82ea924658a6089f3a9ce71dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:36Z,use_quota=True,user_id='adcb144b1a5e4369a1ce56a88067c08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b98624-5cf2-4ebe-9778-8884b0c6d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b98624-5cf2-4ebe-9778-8884b0c6d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2247d2c6-daa1-4c6b-a942-232c81870cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2247d2c6-daa1-4c6b-a942-232c81870cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571ee401-db22-4f67-bf56-54f8e3d16ef5', 'volume_name': 'volume-571ee401-db22-4f67-bf56-54f8e3d16ef5', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3756eb1d-cf04-420f-b0e4-284e1196ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3756eb1d-cf04-420f-b0e4-284e1196ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a638050f-dda9-40c4-90ec-7b9e8667d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:35 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Volume 571ee401-db22-4f67-bf56-54f8e3d16ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571ee401-db22-4f67-bf56-54f8e3d16ef5', 'volume_size': 1}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550915761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571ee401-db22-4f67-bf56-54f8e3d16ef5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e83cd82ea924658a6089f3a9ce71dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:36Z,use_quota=True,user_id='adcb144b1a5e4369a1ce56a88067c08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Creating volume 571ee401-db22-4f67-bf56-54f8e3d16ef5 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:35 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:35 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=37, name=volume-571ee401-db22-4f67-bf56-54f8e3d16ef5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:35 devstack quobyte-client[80089]: System call "getattr" of process 89648 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:35 devstack quobyte-client[80089]: System call "lookup" of process 89648 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:35 devstack quobyte-client[80089]: System call "getattr" of process 89648 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:35 devstack quobyte-client[80089]: System call "open" of process 89648 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5 1073741824" returned: 0 in 0.104s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] <== create_volume: return (130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.132s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a638050f-dda9-40c4-90ec-7b9e8667d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571ee401-db22-4f67-bf56-54f8e3d16ef5', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f1b1ba-649b-458d-8744-16c550b77a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:35 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Volume volume-571ee401-db22-4f67-bf56-54f8e3d16ef5 (571ee401-db22-4f67-bf56-54f8e3d16ef5): created successfully
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f1b1ba-649b-458d-8744-16c550b77a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:35 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Flow 'volume_create_manager' (14475cbf-4625-4c47-8ffa-af4cbb9d178d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3194922b-93e8-45ac-86d0-60dc38a488af tempest-VolumesTestJSON-56975074 None] Created volume successfully.
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Acquiring lock "cinder-571ee401-db22-4f67-bf56-54f8e3d16ef5-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Lock "cinder-571ee401-db22-4f67-bf56-54f8e3d16ef5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Acquiring lock "cinder-quobyte-571ee401-db22-4f67-bf56-54f8e3d16ef5" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Lock "cinder-quobyte-571ee401-db22-4f67-bf56-54f8e3d16ef5" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8833cc8a-12b3-4bde-ae3e-19a73704b05d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5" returned: 0 in 0.138s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-571ee401-db22-4f67-bf56-54f8e3d16ef5" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Lock "cinder-quobyte-571ee401-db22-4f67-bf56-54f8e3d16ef5" released by "delete_volume" :: held 0.195s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Created reservations ['4022506f-52ef-49cb-a7d5-f61a8c0255d9', '5b3b00ea-c191-4846-998d-9c7b0f13a120', '6717d956-162c-4fb1-9d82-06edfa25c01a', 'ab79eaac-56b5-4022-8bd4-80cdc6df9241'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Deleted volume successfully.
Sep 30 15:40:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0a0b7f9d-3bf8-421f-83ca-cb12aa5d7445 tempest-VolumesTestJSON-56975074 None] Lock "cinder-571ee401-db22-4f67-bf56-54f8e3d16ef5-delete_volume" released by "delete_volume" :: held 0.336s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Acquiring lock "cinder-1e5c109c-da09-46c6-b8a2-1fd5698a576a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Lock "cinder-1e5c109c-da09-46c6-b8a2-1fd5698a576a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Acquiring lock "cinder-quobyte-1e5c109c-da09-46c6-b8a2-1fd5698a576a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Lock "cinder-quobyte-1e5c109c-da09-46c6-b8a2-1fd5698a576a" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b9a02f-330a-48d1-baf8-c2fbaf0ace78]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:38 devstack quobyte-client[80089]: System call "getattr" of process 89657 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1e5c109c-da09-46c6-b8a2-1fd5698a576a" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Lock "cinder-quobyte-1e5c109c-da09-46c6-b8a2-1fd5698a576a" released by "delete_volume" :: held 0.181s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Created reservations ['d4f00021-351c-4168-975f-32d7554d2a36', 'ef3e0e2f-5cf4-452d-8fb1-0319be1a59d1', 'cc9ebc50-9905-4364-9525-581729bd0080', 'f93c542f-2ff1-4a4f-9f29-1fc6e5084f01'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Deleted volume successfully.
Sep 30 15:40:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-295d777f-f100-4a24-8f2b-fc2dc25e0c3b tempest-VolumesTestJSON-56975074 None] Lock "cinder-1e5c109c-da09-46c6-b8a2-1fd5698a576a-delete_volume" released by "delete_volume" :: held 0.327s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Acquiring lock "cinder-467d2e3a-e799-4bb6-9234-344e97fbfe14-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Lock "cinder-467d2e3a-e799-4bb6-9234-344e97fbfe14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:39 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Acquiring lock "cinder-quobyte-467d2e3a-e799-4bb6-9234-344e97fbfe14" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Lock "cinder-quobyte-467d2e3a-e799-4bb6-9234-344e97fbfe14" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a6e93-5716-4590-952c-6a2c2792bbde]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-467d2e3a-e799-4bb6-9234-344e97fbfe14" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Lock "cinder-quobyte-467d2e3a-e799-4bb6-9234-344e97fbfe14" released by "delete_volume" :: held 0.184s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Created reservations ['945d1825-d150-4a9b-9cfd-569dabed63f0', '89b28e05-6af9-44ec-8900-8a86ddb50a94', 'a4bb31fc-ed8e-4dac-beb5-5b7bfa515e41', 'f95c6e60-a618-4002-995f-4c8ad73c2724'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:39 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Deleted volume successfully.
Sep 30 15:40:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c25b33d-4cfa-4bf0-bcb3-8759dbad4959 tempest-VolumesTestJSON-56975074 None] Lock "cinder-467d2e3a-e799-4bb6-9234-344e97fbfe14-delete_volume" released by "delete_volume" :: held 0.331s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=19,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:40:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Flow 'volume_create_manager' (10d65b21-d767-4a0b-be0a-d8420bdd0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3daaa1-d034-452f-b2ad-8e2982cf7850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3daaa1-d034-452f-b2ad-8e2982cf7850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2044715084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06cae94-0027-48b6-81a1-824869a3d695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a039130c6b6b4edda50f8895be16e122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:50Z,use_quota=True,user_id='841432a66481462e9d90f7161252eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c21cc8-5f6d-4d9e-833e-4766fe165be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c21cc8-5f6d-4d9e-833e-4766fe165be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb88e36-cd6d-41ef-95f5-eedd98addfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb88e36-cd6d-41ef-95f5-eedd98addfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06cae94-0027-48b6-81a1-824869a3d695', 'volume_name': 'volume-b06cae94-0027-48b6-81a1-824869a3d695', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbf040a-b4b9-49eb-8f25-4128a867ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbf040a-b4b9-49eb-8f25-4128a867ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f7d580-70f6-43b5-af57-1e6bd8d912ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:49 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume b06cae94-0027-48b6-81a1-824869a3d695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06cae94-0027-48b6-81a1-824869a3d695', 'volume_size': 1}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2044715084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06cae94-0027-48b6-81a1-824869a3d695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a039130c6b6b4edda50f8895be16e122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:50Z,use_quota=True,user_id='841432a66481462e9d90f7161252eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Creating volume b06cae94-0027-48b6-81a1-824869a3d695 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:49 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:49 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=38, name=volume-b06cae94-0027-48b6-81a1-824869a3d695, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:49 devstack quobyte-client[80089]: System call "getattr" of process 89698 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695 1073741824" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] <== create_volume: return (155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.157s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f7d580-70f6-43b5-af57-1e6bd8d912ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06cae94-0027-48b6-81a1-824869a3d695', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2817d553-6814-4018-ad84-b6adb8e9cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:50 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume volume-b06cae94-0027-48b6-81a1-824869a3d695 (b06cae94-0027-48b6-81a1-824869a3d695): created successfully
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2817d553-6814-4018-ad84-b6adb8e9cc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Flow 'volume_create_manager' (10d65b21-d767-4a0b-be0a-d8420bdd0523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c48f7229-6451-4dc1-bcb3-6a54fd483d08 tempest-VolumeQuotasAdminTestJSON-787489552 None] Created volume successfully.
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "cinder-b06cae94-0027-48b6-81a1-824869a3d695-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "cinder-b06cae94-0027-48b6-81a1-824869a3d695-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:50 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "cinder-quobyte-b06cae94-0027-48b6-81a1-824869a3d695" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "cinder-quobyte-b06cae94-0027-48b6-81a1-824869a3d695" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd44bb7e-5fe0-4fa7-9231-6c627f7a50d5]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b06cae94-0027-48b6-81a1-824869a3d695" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "cinder-quobyte-b06cae94-0027-48b6-81a1-824869a3d695" released by "delete_volume" :: held 0.199s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Created reservations ['fc2e101e-6959-4a05-884f-a786bd8a9ba2', '633c307f-0d41-4d96-bc63-f138bcf6ddd4', 'a37eb024-4fd9-4c9f-855c-0a725d16193f', '84b34125-278f-4608-9429-264a7f7937de'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Deleted volume successfully.
Sep 30 15:40:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-526162e6-14d0-4c87-97f2-d38abe9be179 tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "cinder-b06cae94-0027-48b6-81a1-824869a3d695-delete_volume" released by "delete_volume" :: held 0.349s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Flow 'volume_create_manager' (deed5d83-1106-4f77-a7e2-05439c8b4855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d25acc6-a061-4ba6-96f8-a7f3f49e7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d25acc6-a061-4ba6-96f8-a7f3f49e7f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-254100116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a67840f-3900-4836-ac34-04c840ee5d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a039130c6b6b4edda50f8895be16e122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:52Z,use_quota=True,user_id='841432a66481462e9d90f7161252eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fb7c65-a769-4c0e-a427-129d39158207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fb7c65-a769-4c0e-a427-129d39158207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8297306-eb7b-493d-9a8d-a68789881747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8297306-eb7b-493d-9a8d-a68789881747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a67840f-3900-4836-ac34-04c840ee5d69', 'volume_name': 'volume-2a67840f-3900-4836-ac34-04c840ee5d69', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99e0b89-6e0d-46da-95e3-39b54e44769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99e0b89-6e0d-46da-95e3-39b54e44769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe65c2c-f67a-44ef-b3bb-724d36b03f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:52 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume 2a67840f-3900-4836-ac34-04c840ee5d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a67840f-3900-4836-ac34-04c840ee5d69', 'volume_size': 1}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-254100116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a67840f-3900-4836-ac34-04c840ee5d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a039130c6b6b4edda50f8895be16e122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:40:52Z,use_quota=True,user_id='841432a66481462e9d90f7161252eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Creating volume 2a67840f-3900-4836-ac34-04c840ee5d69 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:40:52 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:40:52 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=39, name=volume-2a67840f-3900-4836-ac34-04c840ee5d69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69 1073741824" returned: 0 in 0.109s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69" returned: 0 in 0.015s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] <== create_volume: return (133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.136s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe65c2c-f67a-44ef-b3bb-724d36b03f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a67840f-3900-4836-ac34-04c840ee5d69', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583c1e53-e6e0-46fd-827b-e0aec20daea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:40:52 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Volume volume-2a67840f-3900-4836-ac34-04c840ee5d69 (2a67840f-3900-4836-ac34-04c840ee5d69): created successfully
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583c1e53-e6e0-46fd-827b-e0aec20daea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:40:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Flow 'volume_create_manager' (deed5d83-1106-4f77-a7e2-05439c8b4855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:40:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-96acb596-5d49-4a16-8fc3-00c6e0a2eece tempest-VolumeQuotasAdminTestJSON-787489552 None] Created volume successfully.
Sep 30 15:40:53 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d91e7d6c-44a4-4f2f-80a0-cc503b347702 tempest-VolumeQuotasAdminTestJSON-38308206 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:53 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d91e7d6c-44a4-4f2f-80a0-cc503b347702 tempest-VolumeQuotasAdminTestJSON-38308206 None] Transfer volume completed successfully.
Sep 30 15:40:54 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-dc2281b6-2f2e-4793-9be3-7d9f5af5373a req-e6b52d1b-cc7e-4098-855a-e8a617bbacd9 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:54 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-dc2281b6-2f2e-4793-9be3-7d9f5af5373a req-e6b52d1b-cc7e-4098-855a-e8a617bbacd9 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:54 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-dc2281b6-2f2e-4793-9be3-7d9f5af5373a req-e6b52d1b-cc7e-4098-855a-e8a617bbacd9 tempest-AttachVolumeTestJSON-972140354 None] Terminate volume connection completed successfully.
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-dc2281b6-2f2e-4793-9be3-7d9f5af5373a req-e6b52d1b-cc7e-4098-855a-e8a617bbacd9 tempest-AttachVolumeTestJSON-972140354 None] Deleting attachment 794d0b33-47b5-4fe6-be06-d9ee038ccb22. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Acquiring lock "cinder-2a67840f-3900-4836-ac34-04c840ee5d69-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Lock "cinder-2a67840f-3900-4836-ac34-04c840ee5d69-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:54 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Acquiring lock "cinder-quobyte-2a67840f-3900-4836-ac34-04c840ee5d69" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Lock "cinder-quobyte-2a67840f-3900-4836-ac34-04c840ee5d69" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[75396836-b9f4-4a13-a1af-5b95fca9fe60]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69" returned: 0 in 0.151s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2a67840f-3900-4836-ac34-04c840ee5d69" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Lock "cinder-quobyte-2a67840f-3900-4836-ac34-04c840ee5d69" released by "delete_volume" :: held 0.210s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Created reservations ['ba3e01ab-6ad2-45ce-94b9-1c5a13c1c1ab', 'dd757b12-2a24-4213-8a8e-5043c5ad2467', '22b86170-7ca4-4560-8141-85bce103bea0', '520ef20f-5b93-401b-ac77-9f30a0171aef'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:40:54 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Deleted volume successfully.
Sep 30 15:40:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-84aee540-44dd-44c4-967c-956e4b487ff5 tempest-VolumeQuotasAdminTestJSON-440648369 None] Lock "cinder-2a67840f-3900-4836-ac34-04c840ee5d69-delete_volume" released by "delete_volume" :: held 0.410s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:40:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Flow 'volume_create_manager' (0b47826e-c7ea-4dc2-babe-07025d10f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e716b4-2791-4ea9-9247-9bdc861c652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e716b4-2791-4ea9-9247-9bdc861c652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1748587912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44df761f-afd0-4638-85df-df034646d90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4f10a7d9744f088d1368f2e0bad5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:00Z,use_quota=True,user_id='8b6d146076fd41d29137909d5f554a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32c7aa4-2e9c-484d-b798-6d1bacf736a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32c7aa4-2e9c-484d-b798-6d1bacf736a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e442a-7e00-494e-87b7-8a2ec56c0cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e442a-7e00-494e-87b7-8a2ec56c0cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44df761f-afd0-4638-85df-df034646d90e', 'volume_name': 'volume-44df761f-afd0-4638-85df-df034646d90e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0aaa175-d9d4-48c1-82d4-9d5c50737285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0aaa175-d9d4-48c1-82d4-9d5c50737285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e720adf4-754f-4301-aade-449b86bcbea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:00 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Volume 44df761f-afd0-4638-85df-df034646d90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44df761f-afd0-4638-85df-df034646d90e', 'volume_size': 1}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1748587912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44df761f-afd0-4638-85df-df034646d90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4f10a7d9744f088d1368f2e0bad5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:00Z,use_quota=True,user_id='8b6d146076fd41d29137909d5f554a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Creating volume 44df761f-afd0-4638-85df-df034646d90e {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:41:00 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:00 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=40, name=volume-44df761f-afd0-4638-85df-df034646d90e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e 1073741824" returned: 0 in 0.123s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] <== create_volume: return (150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.152s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e720adf4-754f-4301-aade-449b86bcbea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44df761f-afd0-4638-85df-df034646d90e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be04a02-d6a6-4b28-84ca-040d48f9b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:00 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Volume volume-44df761f-afd0-4638-85df-df034646d90e (44df761f-afd0-4638-85df-df034646d90e): created successfully
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be04a02-d6a6-4b28-84ca-040d48f9b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:00 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Flow 'volume_create_manager' (0b47826e-c7ea-4dc2-babe-07025d10f81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1242c8ff-c164-4b4c-89b0-838cd35dfbd0 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Created volume successfully.
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Acquiring lock "cinder-44df761f-afd0-4638-85df-df034646d90e-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "cinder-44df761f-afd0-4638-85df-df034646d90e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:01 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Acquiring lock "cinder-quobyte-44df761f-afd0-4638-85df-df034646d90e" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "cinder-quobyte-44df761f-afd0-4638-85df-df034646d90e" acquired by "delete_volume" :: waited 0.005s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa7d36-8031-4347-95c2-08147b5b6f1e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e" returned: 0 in 0.134s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44df761f-afd0-4638-85df-df034646d90e" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "cinder-quobyte-44df761f-afd0-4638-85df-df034646d90e" released by "delete_volume" :: held 0.172s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Created reservations ['f4585002-a0c9-49d2-9bed-8df9c3c0875a', '58208e63-2474-4f04-a59c-408d90c375b1', '345751a2-7f3a-4443-aed7-3a7acd99429e', 'a6364c8a-f2d5-48f8-a485-b7851668f105'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:41:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Deleted volume successfully.
Sep 30 15:41:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-164232e0-a3e1-4cec-bd9a-42d05d0496d2 tempest-VolumeQuotasNegativeTestJSON-1033050899 None] Lock "cinder-44df761f-afd0-4638-85df-df034646d90e-delete_volume" released by "delete_volume" :: held 0.307s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Flow 'volume_create_manager' (7d1477a1-cacb-4925-acc9-3eeb7ff168f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42d57ff-bbbc-4544-bca8-19a0ec4b0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42d57ff-bbbc-4544-bca8-19a0ec4b0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-666133723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11eb8633-dab9-485f-92ad-23ef328c2ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fea0fc03e14776bb8883a353d4dab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:06Z,use_quota=True,user_id='7b0fd9540fc146a8937882c931102e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5464387-cc4b-4bff-a283-7ec0b2d8e5c8),volume_type_id=f5464387-cc4b-4bff-a283-7ec0b2d8e5c8)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e771378b-1906-4c03-9034-669a23280a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e771378b-1906-4c03-9034-669a23280a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccbbef7-34b7-43cf-9531-24f36b01bcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccbbef7-34b7-43cf-9531-24f36b01bcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11eb8633-dab9-485f-92ad-23ef328c2ed3', 'volume_name': 'volume-11eb8633-dab9-485f-92ad-23ef328c2ed3', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c038e5a1-af0e-47e2-b7f4-706f38176940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c038e5a1-af0e-47e2-b7f4-706f38176940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a33e59-055f-4e76-8aad-320445407231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:06 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Volume 11eb8633-dab9-485f-92ad-23ef328c2ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11eb8633-dab9-485f-92ad-23ef328c2ed3', 'volume_size': 1}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-666133723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11eb8633-dab9-485f-92ad-23ef328c2ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fea0fc03e14776bb8883a353d4dab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:06Z,use_quota=True,user_id='7b0fd9540fc146a8937882c931102e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5464387-cc4b-4bff-a283-7ec0b2d8e5c8),volume_type_id=f5464387-cc4b-4bff-a283-7ec0b2d8e5c8)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Creating volume 11eb8633-dab9-485f-92ad-23ef328c2ed3 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:41:06 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:06 devstack quobyte-client[80089]: System call "ioctl" of process 89783 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:41:06 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=41, name=volume-11eb8633-dab9-485f-92ad-23ef328c2ed3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3 1073741824" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] <== create_volume: return (177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.179s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a33e59-055f-4e76-8aad-320445407231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11eb8633-dab9-485f-92ad-23ef328c2ed3', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7da9a6-0431-4204-ab35-2ab1c14a3a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:06 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Volume volume-11eb8633-dab9-485f-92ad-23ef328c2ed3 (11eb8633-dab9-485f-92ad-23ef328c2ed3): created successfully
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7da9a6-0431-4204-ab35-2ab1c14a3a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:06 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Flow 'volume_create_manager' (7d1477a1-cacb-4925-acc9-3eeb7ff168f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5b1d0e5a-b0bc-4dbe-8b5a-16ad5341268c tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Created volume successfully.
Sep 30 15:41:07 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:07 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:41:07 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f4c1397e-4830-410e-8394-10390deade9f tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Retype volume completed successfully.
Sep 30 15:41:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Acquiring lock "cinder-11eb8633-dab9-485f-92ad-23ef328c2ed3-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "cinder-11eb8633-dab9-485f-92ad-23ef328c2ed3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Acquiring lock "cinder-quobyte-11eb8633-dab9-485f-92ad-23ef328c2ed3" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "cinder-quobyte-11eb8633-dab9-485f-92ad-23ef328c2ed3" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a14c452-1d15-4edb-9c81-38b087a4971c]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:41:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:08 devstack quobyte-client[80089]: System call "getattr" of process 89879 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3" returned: 0 in 0.162s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-11eb8633-dab9-485f-92ad-23ef328c2ed3" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "cinder-quobyte-11eb8633-dab9-485f-92ad-23ef328c2ed3" released by "delete_volume" :: held 0.210s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:09 devstack cinder-volume[80302]: WARNING cinder.quota [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:41:09 devstack cinder-volume[80302]: WARNING cinder.quota [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Created reservations ['ca02ad7c-f712-459b-8e05-9c1a49c789b3', '8e470df4-ca9b-4740-9c7c-a189297a61f3', '6f61085a-0140-408a-9474-23987aa44b2b', 'd3a48a75-b025-445c-a8ac-176c95429882'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:41:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Deleted volume successfully.
Sep 30 15:41:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ebf489b7-18ac-45de-9f1e-ec05e7a7004b tempest-VolumeRetypeWithoutMigrationTest-830271624 None] Lock "cinder-11eb8633-dab9-485f-92ad-23ef328c2ed3-delete_volume" released by "delete_volume" :: held 0.386s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Flow 'volume_create_manager' (cc978b9e-9d0d-4801-bf59-f217632b9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bacf2c5-a790-4ff4-b1a4-0cec6bc4a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bacf2c5-a790-4ff4-b1a4-0cec6bc4a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-822584417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9e3b45-6546-4e0d-acaf-b4473d83effe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55933c2d5411494ab0f57a5e8e34a293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:13Z,use_quota=True,user_id='18135beee7c44e4dbebe4b5c3e2533d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1831a71-3513-4f19-8890-7b3358b978c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1831a71-3513-4f19-8890-7b3358b978c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7534c69-c598-414f-9366-423bb7be728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7534c69-c598-414f-9366-423bb7be728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9e3b45-6546-4e0d-acaf-b4473d83effe', 'volume_name': 'volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde991a2-9ea3-40c0-bfc8-613657977418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde991a2-9ea3-40c0-bfc8-613657977418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d899dee-5c05-4adc-b4ef-f499f7d3e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:13 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Volume 7f9e3b45-6546-4e0d-acaf-b4473d83effe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe', 'volume_size': 1}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-822584417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9e3b45-6546-4e0d-acaf-b4473d83effe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55933c2d5411494ab0f57a5e8e34a293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:13Z,use_quota=True,user_id='18135beee7c44e4dbebe4b5c3e2533d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Creating volume 7f9e3b45-6546-4e0d-acaf-b4473d83effe {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:41:13 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:13 devstack quobyte-client[80089]: System call "open" of process 89921 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:41:13 devstack quobyte-client[80089]: System call "ioctl" of process 89921 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:41:13 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=42, name=volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe 1073741824" returned: 0 in 0.121s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] <== create_volume: return (153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.156s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d899dee-5c05-4adc-b4ef-f499f7d3e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef45a16f-0156-4a40-9cba-2143364cfb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:13 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Volume volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe (7f9e3b45-6546-4e0d-acaf-b4473d83effe): created successfully
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef45a16f-0156-4a40-9cba-2143364cfb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Flow 'volume_create_manager' (cc978b9e-9d0d-4801-bf59-f217632b9eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:13 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1c261a78-6fe4-4c4e-87e1-1ad10e7f8ba3 tempest-VolumesServicesTestJSON-344949877 None] Created volume successfully.
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Acquiring lock "cinder-7f9e3b45-6546-4e0d-acaf-b4473d83effe-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Lock "cinder-7f9e3b45-6546-4e0d-acaf-b4473d83effe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Acquiring lock "cinder-quobyte-7f9e3b45-6546-4e0d-acaf-b4473d83effe" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Lock "cinder-quobyte-7f9e3b45-6546-4e0d-acaf-b4473d83effe" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad4345-8bb1-4e0c-a72f-74f58255e742]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe" returned: 0 in 0.151s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7f9e3b45-6546-4e0d-acaf-b4473d83effe" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Lock "cinder-quobyte-7f9e3b45-6546-4e0d-acaf-b4473d83effe" released by "delete_volume" :: held 0.209s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Created reservations ['1901d286-3110-4d83-bd62-8a6ea2418e99', 'e1437767-37e9-4598-a2f9-2b015624582a', 'db46f8db-0f28-4cbc-837f-12b762d46ca4', 'e134e42d-1786-4467-900a-88bf5773db5f'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:41:14 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Deleted volume successfully.
Sep 30 15:41:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-153275cd-a39d-4b59-be7e-06a74f1bb0a4 tempest-VolumesServicesTestJSON-344949877 None] Lock "cinder-7f9e3b45-6546-4e0d-acaf-b4473d83effe-delete_volume" released by "delete_volume" :: held 0.356s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:24 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=57,cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=9 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:41:24 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=67,cinder:SELECT=57,cinder:DELETE=9,cinder:INSERT=23 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:41:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:33 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Flow 'volume_create_manager' (dad0b476-fe40-4f6a-8e4d-ccd4f0f95474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e17414-762f-4353-a2c1-eca763953e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e17414-762f-4353-a2c1-eca763953e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1471585250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1bdaf7-8133-4cdc-89b2-e29e34a9a625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1cbc8a58474a878d135b0e40371238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:33Z,use_quota=True,user_id='8b13974ed4764aecafc5ba63f6856882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a9ffdf-4d2f-45fc-b131-e7fee2867abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a9ffdf-4d2f-45fc-b131-e7fee2867abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679d2c1c-bbec-4f25-bfd3-f1e7a1abe26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679d2c1c-bbec-4f25-bfd3-f1e7a1abe26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1bdaf7-8133-4cdc-89b2-e29e34a9a625', 'volume_name': 'volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63eaf099-af6e-4be5-9024-5c36c2b09829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63eaf099-af6e-4be5-9024-5c36c2b09829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715570bd-54fd-4206-b8fa-dfdd3d88462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:33 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Volume 4c1bdaf7-8133-4cdc-89b2-e29e34a9a625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625', 'volume_size': 1}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1471585250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1bdaf7-8133-4cdc-89b2-e29e34a9a625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1cbc8a58474a878d135b0e40371238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:33Z,use_quota=True,user_id='8b13974ed4764aecafc5ba63f6856882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Creating volume 4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:41:33 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:33 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=43, name=volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 1073741824" returned: 0 in 0.180s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] <== create_volume: return (210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.212s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715570bd-54fd-4206-b8fa-dfdd3d88462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e6369e-cf88-4566-9886-0dbf74d9e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:33 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Volume volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 (4c1bdaf7-8133-4cdc-89b2-e29e34a9a625): created successfully
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e6369e-cf88-4566-9886-0dbf74d9e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:33 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Flow 'volume_create_manager' (dad0b476-fe40-4f6a-8e4d-ccd4f0f95474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b773d4d6-2017-4252-9bb8-29a05b38ae28 tempest-AttachVolumeNegativeTest-1425499349 None] Created volume successfully.
Sep 30 15:41:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0bd020-0a01-4f1c-be07-cfd45a466caa]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.150s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '169d10fc-db1a-4551-b80b-e4a7650d5c09', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:41:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-97dce933-9fee-42de-8dd9-7e2d981f4ed3 req-f5b8acd7-9f7b-42d9-a57f-0503fbe5d6bf tempest-AttachVolumeNegativeTest-1425499349 None] attachment_update completed successfully.
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:41:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:47 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:41:47 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:41:50 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (d521c61f-f2db-424c-912a-b3fce1feb646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a04f03a-4e60-4039-afbc-0665038ed337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a04f03a-4e60-4039-afbc-0665038ed337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108335344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634bcb7f-059e-40ed-b3ed-1b712db73340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:50Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8980b7e-21f6-4242-95d9-e72f991ab63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8980b7e-21f6-4242-95d9-e72f991ab63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d229f9ba-2b20-4193-842b-534cf6c53997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d229f9ba-2b20-4193-842b-534cf6c53997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '634bcb7f-059e-40ed-b3ed-1b712db73340', 'volume_name': 'volume-634bcb7f-059e-40ed-b3ed-1b712db73340', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03828461-2e85-4c68-9954-bb0e696ad710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03828461-2e85-4c68-9954-bb0e696ad710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f9b8d8-7b0a-4d69-aa97-7b526c187865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:50 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Volume 634bcb7f-059e-40ed-b3ed-1b712db73340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-634bcb7f-059e-40ed-b3ed-1b712db73340', 'volume_size': 1}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108335344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634bcb7f-059e-40ed-b3ed-1b712db73340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:41:50Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Creating volume 634bcb7f-059e-40ed-b3ed-1b712db73340 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:41:50 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:50 devstack quobyte-client[80089]: System call "open" of process 90514 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:41:50 devstack quobyte-client[80089]: System call "ioctl" of process 90514 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:41:50 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=44, name=volume-634bcb7f-059e-40ed-b3ed-1b712db73340, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340 1073741824" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] <== create_volume: return (161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.163s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f9b8d8-7b0a-4d69-aa97-7b526c187865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634bcb7f-059e-40ed-b3ed-1b712db73340', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba419a0-735c-47d2-a3c6-1b2be6a17e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:41:50 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Volume volume-634bcb7f-059e-40ed-b3ed-1b712db73340 (634bcb7f-059e-40ed-b3ed-1b712db73340): created successfully
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba419a0-735c-47d2-a3c6-1b2be6a17e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:41:50 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (d521c61f-f2db-424c-912a-b3fce1feb646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:41:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c01df753-d750-4ca4-9650-eba29b90fd6c tempest-VolumesActionsTest-1416664200 None] Created volume successfully.
Sep 30 15:41:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b648c471-0c39-4f2a-801b-dc9781fccc0a tempest-VolumesActionsTest-1416664200 None] Acquiring lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340" by "attach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b648c471-0c39-4f2a-801b-dc9781fccc0a tempest-VolumesActionsTest-1416664200 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340" acquired by "attach_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:51 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b648c471-0c39-4f2a-801b-dc9781fccc0a tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b648c471-0c39-4f2a-801b-dc9781fccc0a tempest-VolumesActionsTest-1416664200 None] Attaching volume 634bcb7f-059e-40ed-b3ed-1b712db73340 to instance 0b619571-af1d-491f-bf43-9a5b15420b71 at mountpoint /dev/vdb on host None.
Sep 30 15:41:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b648c471-0c39-4f2a-801b-dc9781fccc0a tempest-VolumesActionsTest-1416664200 None] Attach volume completed successfully.
Sep 30 15:41:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b648c471-0c39-4f2a-801b-dc9781fccc0a tempest-VolumesActionsTest-1416664200 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340" released by "attach_volume" :: held 0.074s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Terminate volume connection completed successfully.
Sep 30 15:41:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:41:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-detach_volume" by "detach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Detaching volume 634bcb7f-059e-40ed-b3ed-1b712db73340 from instance 0b619571-af1d-491f-bf43-9a5b15420b71.
Sep 30 15:41:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Detach volume completed successfully.
Sep 30 15:41:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7035d16a-c769-427e-8300-ef0a29e476bc tempest-VolumesActionsTest-47228607 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d8b020b9-5375-43d0-9bd3-b6c22b3fba80 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-detach_volume" by "detach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d8b020b9-5375-43d0-9bd3-b6c22b3fba80 tempest-VolumesActionsTest-1416664200 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:53 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d8b020b9-5375-43d0-9bd3-b6c22b3fba80 tempest-VolumesActionsTest-1416664200 None] Volume detach called, but volume not attached.
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d8b020b9-5375-43d0-9bd3-b6c22b3fba80 tempest-VolumesActionsTest-1416664200 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-detach_volume" released by "detach_volume" :: held 0.009s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Acquiring lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:53 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Acquiring lock "cinder-quobyte-634bcb7f-059e-40ed-b3ed-1b712db73340" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:41:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Lock "cinder-quobyte-634bcb7f-059e-40ed-b3ed-1b712db73340" acquired by "delete_volume" :: waited 0.014s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[34428b19-f8f5-4372-bed1-4d0abcfb767d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-634bcb7f-059e-40ed-b3ed-1b712db73340" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Lock "cinder-quobyte-634bcb7f-059e-40ed-b3ed-1b712db73340" released by "delete_volume" :: held 0.183s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Created reservations ['3d08dbee-70b1-4798-8616-16f252914c1e', '11937212-bf0c-4102-a0ef-688715a8f517', '21fa49d7-69f9-41c2-a667-b6cd78a5f42b', '62faf26c-0104-41b8-968a-48ba2abc49c1'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:41:54 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Deleted volume successfully.
Sep 30 15:41:54 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6d1058c7-cbb4-4ac1-8115-8e350e90b96c tempest-VolumesActionsTest-1416664200 None] Lock "cinder-634bcb7f-059e-40ed-b3ed-1b712db73340-delete_volume" released by "delete_volume" :: held 0.326s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:41:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (3cc0ab4e-8f78-446c-b864-c3f97b503556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6363121-57f8-464b-8095-8f1e8b8f587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6363121-57f8-464b-8095-8f1e8b8f587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193801188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:03Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da190777-5da1-4b40-b96f-1c4d553004e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da190777-5da1-4b40-b96f-1c4d553004e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee408e0-dab9-42e0-9f84-1410f2448356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee408e0-dab9-42e0-9f84-1410f2448356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe', 'volume_name': 'volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1570f08c-70a4-4f0b-8b6e-fc0ce82c1464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1570f08c-70a4-4f0b-8b6e-fc0ce82c1464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9ec0fa-4614-4df2-8dc4-e4931a931661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:02 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Volume 7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe', 'volume_size': 1}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193801188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:03Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Creating volume 7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:02 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:02 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=45, name=volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe 1073741824" returned: 0 in 0.107s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] <== create_volume: return (152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.155s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9ec0fa-4614-4df2-8dc4-e4931a931661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8a7b80-892b-4387-982a-08de759ebd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:02 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Volume volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe (7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe): created successfully
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8a7b80-892b-4387-982a-08de759ebd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (3cc0ab4e-8f78-446c-b864-c3f97b503556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1777df5e-8303-440b-a678-e482986a58d5 tempest-VolumesActionsTest-1416664200 None] Created volume successfully.
Sep 30 15:42:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Lock "cinder-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:03 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-quobyte-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:03 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0077c0f-d438-47fc-affa-79901c6a73a8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe" released by "delete_volume" :: held 0.186s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Created reservations ['abad0304-5db3-4622-a0c2-4266f192cda4', '61e66aeb-86da-4ef0-b6f1-4393f59c54fd', 'c6b75646-94fc-422d-8c25-5fecafd67deb', '6668d328-631c-4fc1-886f-0d7c3e356913'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Deleted volume successfully.
Sep 30 15:42:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-61f0de42-957e-4af4-a54c-8944f0b7341b tempest-VolumesActionsTest-47228607 None] Lock "cinder-7c5a6542-3b7e-4bc9-8099-6638ee7f1dbe-delete_volume" released by "delete_volume" :: held 0.371s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-890bf203-9259-4753-bfca-0559e23aad08 req-f062e710-3c3f-46e6-ae31-f867c93790f7 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-890bf203-9259-4753-bfca-0559e23aad08 req-f062e710-3c3f-46e6-ae31-f867c93790f7 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-890bf203-9259-4753-bfca-0559e23aad08 req-f062e710-3c3f-46e6-ae31-f867c93790f7 tempest-AttachVolumeNegativeTest-1425499349 None] Terminate volume connection completed successfully.
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-890bf203-9259-4753-bfca-0559e23aad08 req-f062e710-3c3f-46e6-ae31-f867c93790f7 tempest-AttachVolumeNegativeTest-1425499349 None] Deleting attachment 169d10fc-db1a-4551-b80b-e4a7650d5c09. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:42:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (a12c29ae-e022-4f83-af6b-14195431a885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bb0d9b-d295-44e4-b65f-f4f2631b9af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bb0d9b-d295-44e4-b65f-f4f2631b9af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831428205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adb2738-ae73-43ef-ba1b-56aab5d25c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:05Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149dec72-70ad-475e-b03e-954f4dd32f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149dec72-70ad-475e-b03e-954f4dd32f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781b2666-d695-4cab-9c5d-3e6c92352d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781b2666-d695-4cab-9c5d-3e6c92352d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adb2738-ae73-43ef-ba1b-56aab5d25c71', 'volume_name': 'volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f538d704-79fe-4eff-ab08-948569b6d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f538d704-79fe-4eff-ab08-948569b6d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c9062-6388-42d5-a6c0-31348433d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:05 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Volume 0adb2738-ae73-43ef-ba1b-56aab5d25c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71', 'volume_size': 1}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831428205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adb2738-ae73-43ef-ba1b-56aab5d25c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:05Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Creating volume 0adb2738-ae73-43ef-ba1b-56aab5d25c71 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:05 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:05 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=46, name=volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:05 devstack quobyte-client[80089]: System call "lookup" of process 90698 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:05 devstack quobyte-client[80089]: System call "getattr" of process 90698 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71 1073741824" returned: 0 in 0.107s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] <== create_volume: return (130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.132s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c9062-6388-42d5-a6c0-31348433d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b108425-d227-4f39-b1c1-acdb73b04aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:05 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Volume volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71 (0adb2738-ae73-43ef-ba1b-56aab5d25c71): created successfully
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b108425-d227-4f39-b1c1-acdb73b04aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (a12c29ae-e022-4f83-af6b-14195431a885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e4cc9fba-1ad2-4c45-9683-8e4457329729 tempest-VolumesActionsTest-1416664200 None] Created volume successfully.
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-0adb2738-ae73-43ef-ba1b-56aab5d25c71-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Lock "cinder-0adb2738-ae73-43ef-ba1b-56aab5d25c71-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-quobyte-0adb2738-ae73-43ef-ba1b-56aab5d25c71" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-0adb2738-ae73-43ef-ba1b-56aab5d25c71" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0679e08-d19d-447c-904c-28a551e683b4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0adb2738-ae73-43ef-ba1b-56aab5d25c71" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-0adb2738-ae73-43ef-ba1b-56aab5d25c71" released by "delete_volume" :: held 0.193s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Created reservations ['4dd04f17-032a-44a2-9177-5dc60eb6cc78', 'f544b102-4e6d-4fb9-a16a-6b0c9c6eabdb', '53a71e77-7451-4115-969d-199ac628c6a8', '09ebce3b-bd46-40b3-8aee-9e49a97fbd13'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:07 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:07 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Deleted volume successfully.
Sep 30 15:42:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19dc2356-78eb-46fa-876e-04c9830d7f02 tempest-VolumesActionsTest-47228607 None] Lock "cinder-0adb2738-ae73-43ef-ba1b-56aab5d25c71-delete_volume" released by "delete_volume" :: held 0.356s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (0e398893-1426-4275-bde5-6a33fe0e9a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44ec88b-f613-41b7-8eeb-3377648805a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44ec88b-f613-41b7-8eeb-3377648805a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-462558427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b3118c-0994-4225-9633-86a3fcb4fe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:08Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370988d1-065f-4ff0-a4f1-eac4079bcf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370988d1-065f-4ff0-a4f1-eac4079bcf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bb37bb-1109-4de2-8993-d80d3e152a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bb37bb-1109-4de2-8993-d80d3e152a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b3118c-0994-4225-9633-86a3fcb4fe56', 'volume_name': 'volume-48b3118c-0994-4225-9633-86a3fcb4fe56', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a863d81f-72c7-40b9-bca4-df3fffcd3241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a863d81f-72c7-40b9-bca4-df3fffcd3241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f217ab-ff3d-49d4-a368-40dfa0c27f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:08 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Volume 48b3118c-0994-4225-9633-86a3fcb4fe56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b3118c-0994-4225-9633-86a3fcb4fe56', 'volume_size': 1}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-462558427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b3118c-0994-4225-9633-86a3fcb4fe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:08Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Creating volume 48b3118c-0994-4225-9633-86a3fcb4fe56 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:08 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:08 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=47, name=volume-48b3118c-0994-4225-9633-86a3fcb4fe56, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56 1073741824" returned: 0 in 0.106s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] <== create_volume: return (132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.134s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f217ab-ff3d-49d4-a368-40dfa0c27f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b3118c-0994-4225-9633-86a3fcb4fe56', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee258c6-ba1c-45fe-add3-50714d7f9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:08 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Volume volume-48b3118c-0994-4225-9633-86a3fcb4fe56 (48b3118c-0994-4225-9633-86a3fcb4fe56): created successfully
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee258c6-ba1c-45fe-add3-50714d7f9154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:08 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (0e398893-1426-4275-bde5-6a33fe0e9a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-79b59d85-876f-4b51-94e5-82b9991012d8 tempest-VolumesActionsTest-1416664200 None] Created volume successfully.
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-48b3118c-0994-4225-9633-86a3fcb4fe56-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Lock "cinder-48b3118c-0994-4225-9633-86a3fcb4fe56-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-quobyte-48b3118c-0994-4225-9633-86a3fcb4fe56" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-48b3118c-0994-4225-9633-86a3fcb4fe56" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391b2a4-1db8-4bf1-91c6-2b02848a5fed]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48b3118c-0994-4225-9633-86a3fcb4fe56" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-48b3118c-0994-4225-9633-86a3fcb4fe56" released by "delete_volume" :: held 0.212s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Created reservations ['d71b4409-a9d7-4c2c-b080-6973cfe462b4', '4e6b605a-faba-4dcf-91dc-c0002711ac7a', '44041105-7c9a-491f-a3a7-76c30389a68e', 'b879d01a-163e-460c-9b20-c2267402716c'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Deleted volume successfully.
Sep 30 15:42:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-316bb05d-4e0d-41ed-9810-e61da4b96b88 tempest-VolumesActionsTest-47228607 None] Lock "cinder-48b3118c-0994-4225-9633-86a3fcb4fe56-delete_volume" released by "delete_volume" :: held 0.413s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (6768d5e4-1b2e-466e-b036-56cff585649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040eeebe-87fa-4e3b-9c42-cde7b5e4fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040eeebe-87fa-4e3b-9c42-cde7b5e4fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-714679095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a467a4c-9e01-4656-ae3c-b94b44e293a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:11Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5bc14b-e6a7-458e-98cf-f324a346e5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5bc14b-e6a7-458e-98cf-f324a346e5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5300ea05-0d9f-48eb-b779-b97fc9b00f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5300ea05-0d9f-48eb-b779-b97fc9b00f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a467a4c-9e01-4656-ae3c-b94b44e293a6', 'volume_name': 'volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501ff83c-ae7f-4ede-96a4-7a5f176f1a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501ff83c-ae7f-4ede-96a4-7a5f176f1a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817151b0-da6f-4c2c-9f0c-49881edd137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:10 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Volume 5a467a4c-9e01-4656-ae3c-b94b44e293a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6', 'volume_size': 1}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-714679095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a467a4c-9e01-4656-ae3c-b94b44e293a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:11Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Creating volume 5a467a4c-9e01-4656-ae3c-b94b44e293a6 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:10 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:10 devstack quobyte-client[80089]: System call "open" of process 90793 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:10 devstack quobyte-client[80089]: System call "ioctl" of process 90793 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:10 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=48, name=volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6 1073741824" returned: 0 in 0.124s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] <== create_volume: return (172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.174s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817151b0-da6f-4c2c-9f0c-49881edd137a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd1eb8b-5cb0-4413-bfd2-d0dd061bbaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:10 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Volume volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6 (5a467a4c-9e01-4656-ae3c-b94b44e293a6): created successfully
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd1eb8b-5cb0-4413-bfd2-d0dd061bbaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (6768d5e4-1b2e-466e-b036-56cff585649e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-549827f6-c9e3-4a37-ac57-5a042426273b tempest-VolumesActionsTest-1416664200 None] Created volume successfully.
Sep 30 15:42:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-5a467a4c-9e01-4656-ae3c-b94b44e293a6-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Lock "cinder-5a467a4c-9e01-4656-ae3c-b94b44e293a6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:11 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Acquiring lock "cinder-quobyte-5a467a4c-9e01-4656-ae3c-b94b44e293a6" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-5a467a4c-9e01-4656-ae3c-b94b44e293a6" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:11 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2dc41-e42b-4de0-9c95-14c3c848c826]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6" returned: 0 in 0.151s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a467a4c-9e01-4656-ae3c-b94b44e293a6" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Lock "cinder-quobyte-5a467a4c-9e01-4656-ae3c-b94b44e293a6" released by "delete_volume" :: held 0.204s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Created reservations ['615ca7c8-f30e-4735-bdab-767c95badacd', '01154ac1-0bd1-4a90-a387-051af186d9d1', 'f3b0a1b7-8024-4ddc-91b0-77ffef9074ed', '5f4c2d35-5738-477f-851a-d52f75e1e398'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:12 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Deleted volume successfully.
Sep 30 15:42:12 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5c6958d0-6e0b-410b-8736-da7236f4cf4d tempest-VolumesActionsTest-47228607 None] Lock "cinder-5a467a4c-9e01-4656-ae3c-b94b44e293a6-delete_volume" released by "delete_volume" :: held 0.358s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (f9ec41c9-842e-42e4-bfc4-4d0e7cb0db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f22fe7-2f20-4d7c-a0d4-7d30ca77451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f22fe7-2f20-4d7c-a0d4-7d30ca77451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726719807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9047736-703a-45e8-8a74-23d81ab3ac06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:13Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16ae9c2-7ad0-453e-84b1-6d561279ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16ae9c2-7ad0-453e-84b1-6d561279ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7deaac2c-c60f-498d-bbca-da3e2e52b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7deaac2c-c60f-498d-bbca-da3e2e52b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9047736-703a-45e8-8a74-23d81ab3ac06', 'volume_name': 'volume-e9047736-703a-45e8-8a74-23d81ab3ac06', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1c1292-bfa5-479a-ad10-13d1ec956961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1c1292-bfa5-479a-ad10-13d1ec956961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec63e0a-564e-4293-a432-d762de4458d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:13 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Volume e9047736-703a-45e8-8a74-23d81ab3ac06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9047736-703a-45e8-8a74-23d81ab3ac06', 'volume_size': 1}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726719807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9047736-703a-45e8-8a74-23d81ab3ac06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a17beee04433e93579db981045771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:13Z,use_quota=True,user_id='18060aa107ac48329a033fee6a39bf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Creating volume e9047736-703a-45e8-8a74-23d81ab3ac06 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:13 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:13 devstack quobyte-client[80089]: System call "open" of process 90818 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:13 devstack quobyte-client[80089]: System call "ioctl" of process 90818 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:13 devstack quobyte-client[80089]: System call "open" of process 90818 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:13 devstack quobyte-client[80089]: System call "ioctl" of process 90818 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:13 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=49, name=volume-e9047736-703a-45e8-8a74-23d81ab3ac06, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06 1073741824" returned: 0 in 0.120s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] <== create_volume: return (144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.147s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec63e0a-564e-4293-a432-d762de4458d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9047736-703a-45e8-8a74-23d81ab3ac06', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81be2392-fe7a-45da-845c-af311a0828e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:13 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Volume volume-e9047736-703a-45e8-8a74-23d81ab3ac06 (e9047736-703a-45e8-8a74-23d81ab3ac06): created successfully
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81be2392-fe7a-45da-845c-af311a0828e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Flow 'volume_create_manager' (f9ec41c9-842e-42e4-bfc4-4d0e7cb0db17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:13 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-fc2066fd-78ab-45cd-92c2-f95b0a37d499 tempest-VolumesActionsTest-1416664200 None] Created volume successfully.
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "cinder-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "cinder-quobyte-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-quobyte-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c796d-f256-4d15-a1c3-af8a25909cf6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-quobyte-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625" released by "delete_volume" :: held 0.209s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "cinder-e9047736-703a-45e8-8a74-23d81ab3ac06-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Lock "cinder-e9047736-703a-45e8-8a74-23d81ab3ac06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Created reservations ['612a3c5d-3141-40da-9d9d-7c82e9a27d45', 'dc402810-86c8-4923-ad48-1aacb9076b05', '6e0d4f99-8b94-4eea-b1fb-31d11df4943e', '5cb9cfcd-7704-40c2-9979-c81096fdd306'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "cinder-quobyte-e9047736-703a-45e8-8a74-23d81ab3ac06" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Lock "cinder-quobyte-e9047736-703a-45e8-8a74-23d81ab3ac06" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ff551-600f-41d5-ac94-99f45235301d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:14 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Deleted volume successfully.
Sep 30 15:42:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-8da9bf51-c5e9-4b8f-81f2-e20f5e58bb85 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-4c1bdaf7-8133-4cdc-89b2-e29e34a9a625-delete_volume" released by "delete_volume" :: held 0.438s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06" returned: 0 in 0.178s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e9047736-703a-45e8-8a74-23d81ab3ac06" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Lock "cinder-quobyte-e9047736-703a-45e8-8a74-23d81ab3ac06" released by "delete_volume" :: held 0.225s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Created reservations ['931febf4-55f9-4763-ba35-cd79fbea5edc', '57f6f684-561c-41e1-a5b1-663c954f0644', '81b8a38a-0e28-4284-99f4-bfa02050c2c5', 'cf342f9b-18a9-4e61-9c1c-809585e8c509'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:15 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Deleted volume successfully.
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-381c7b63-4d30-4d99-b9aa-6c2ca39f4f44 tempest-VolumesActionsTest-1416664200 None] Lock "cinder-e9047736-703a-45e8-8a74-23d81ab3ac06-delete_volume" released by "delete_volume" :: held 0.393s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "cinder-0b162e8a-8373-4584-9c13-029479a6ee1a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-0b162e8a-8373-4584-9c13-029479a6ee1a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "cinder-quobyte-0b162e8a-8373-4584-9c13-029479a6ee1a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-quobyte-0b162e8a-8373-4584-9c13-029479a6ee1a" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[822204c1-73d8-486e-9437-48841c6b080d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0b162e8a-8373-4584-9c13-029479a6ee1a" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-quobyte-0b162e8a-8373-4584-9c13-029479a6ee1a" released by "delete_volume" :: held 0.196s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Created reservations ['6ddc4319-c909-4ed9-b5f0-165af21b92a5', 'e9d69f9e-c273-40e7-9f93-853c9416b04b', '025b3529-60d3-4654-b25e-226a0e67d487', '962b6729-548f-49ea-be96-a40885fe5885'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.080s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Deleted volume successfully.
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e9d9c3e0-7e30-45d9-ba57-ef97ac8806c0 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-0b162e8a-8373-4584-9c13-029479a6ee1a-delete_volume" released by "delete_volume" :: held 0.547s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "cinder-4164840e-9627-4f3a-8b35-ea5a6b4f8d71-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-4164840e-9627-4f3a-8b35-ea5a6b4f8d71-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:17 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "cinder-quobyte-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-quobyte-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa57d5ae-b2f6-4d94-8e3b-486c6560e5e4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" returned: 0 in 0.153s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-quobyte-4164840e-9627-4f3a-8b35-ea5a6b4f8d71" released by "delete_volume" :: held 0.220s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Created reservations ['d1377efd-d154-464d-a353-4cdf15aa1dfe', '649487e1-a0a6-459e-b998-a3169d62c612', '31364127-475a-462d-914d-5526cf1bc519', '72fb05c2-68a4-480f-a288-0a20c152906d'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Deleted volume successfully.
Sep 30 15:42:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ca8e9a8b-c74e-42ed-a79c-3f055f593eb8 tempest-AttachVolumeNegativeTest-1425499349 None] Lock "cinder-4164840e-9627-4f3a-8b35-ea5a6b4f8d71-delete_volume" released by "delete_volume" :: held 0.408s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-511bdf67-b411-4155-a445-c9bde411f81f tempest-GroupSnapshotsV319Test-425936091 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-511bdf67-b411-4155-a445-c9bde411f81f tempest-GroupSnapshotsV319Test-425936091 None] Group tempest-GroupSnapshotsV319Test-Group-1526985159: creating
Sep 30 15:42:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-511bdf67-b411-4155-a445-c9bde411f81f tempest-GroupSnapshotsV319Test-425936091 None] Group tempest-GroupSnapshotsV319Test-Group-1526985159: created successfully
Sep 30 15:42:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-511bdf67-b411-4155-a445-c9bde411f81f tempest-GroupSnapshotsV319Test-425936091 None] Create group completed successfully.
Sep 30 15:42:25 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Flow 'volume_create_manager' (d77a3346-7812-4fef-ba84-e9b6a787b867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e09177d-f7d6-456c-9ab6-b4dbc898d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e09177d-f7d6-456c-9ab6-b4dbc898d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320725899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ad8129e1-b854-4bc4-938e-80acd577caa3,host='devstack@QuobyteHD#QuobyteHD',id=7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b9e88bfa804804915b02fc69cf3fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:25Z,use_quota=True,user_id='bab7215b4fcb4b0b9b0c08db473a3457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75e68848-0da9-4a46-a719-ffd296a5b405),volume_type_id=75e68848-0da9-4a46-a719-ffd296a5b405)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9b8e17-23f5-4db6-ac53-e7c0e0d4cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9b8e17-23f5-4db6-ac53-e7c0e0d4cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1db4de-375c-45e6-a1d9-0b60236f10f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1db4de-375c-45e6-a1d9-0b60236f10f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0', 'volume_name': 'volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e29b570-6c34-4143-9c80-c0f9f37363b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e29b570-6c34-4143-9c80-c0f9f37363b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abdb34e-89b6-44cd-b8e8-846e85cdcf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:25 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Volume 7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0', 'volume_size': 1}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ad8129e1-b854-4bc4-938e-80acd577caa3,created_at=2025-09-30T13:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320725899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ad8129e1-b854-4bc4-938e-80acd577caa3,host='devstack@QuobyteHD#QuobyteHD',id=7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b9e88bfa804804915b02fc69cf3fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:25Z,use_quota=True,user_id='bab7215b4fcb4b0b9b0c08db473a3457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75e68848-0da9-4a46-a719-ffd296a5b405),volume_type_id=75e68848-0da9-4a46-a719-ffd296a5b405)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Creating volume 7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:25 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:25 devstack quobyte-client[80089]: System call "open" of process 90937 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:25 devstack quobyte-client[80089]: System call "ioctl" of process 90937 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:25 devstack quobyte-client[80089]: System call "open" of process 90937 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:25 devstack quobyte-client[80089]: System call "ioctl" of process 90937 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:25 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=50, name=volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 1073741824" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] <== create_volume: return (174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.177s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abdb34e-89b6-44cd-b8e8-846e85cdcf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe4d049-d77c-4c8e-85f9-8c19ff3bbe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:25 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Volume volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 (7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0): created successfully
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe4d049-d77c-4c8e-85f9-8c19ff3bbe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Flow 'volume_create_manager' (d77a3346-7812-4fef-ba84-e9b6a787b867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:25 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a4f0acf6-0a85-4d17-97e7-548dfe02687e tempest-GroupSnapshotsV319Test-425936091 None] Created volume successfully.
Sep 30 15:42:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Flow 'volume_create_manager' (24c433e6-07d9-4218-9a08-a1a1541306a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbaad29-cfe3-4486-8c97-1ce8d138015c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbaad29-cfe3-4486-8c97-1ce8d138015c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1301686684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6290a10b-6f27-4f38-9e32-dbf334ddb8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd78c6971e144b59b38897f70e446ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:26Z,use_quota=True,user_id='f036959b39a2447da4a61ff8014d12da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d460e921-25d4-40d6-b2ac-16ca220d88d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d460e921-25d4-40d6-b2ac-16ca220d88d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b16ab-eba8-438e-9dd6-5dfed6e5fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b16ab-eba8-438e-9dd6-5dfed6e5fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6290a10b-6f27-4f38-9e32-dbf334ddb8ce', 'volume_name': 'volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b7ba55-af1e-4b9e-ba1e-893ccd653106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b7ba55-af1e-4b9e-ba1e-893ccd653106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8328015-8e39-4740-beed-047fef5ffc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:26 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Volume 6290a10b-6f27-4f38-9e32-dbf334ddb8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce', 'volume_size': 1}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1301686684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6290a10b-6f27-4f38-9e32-dbf334ddb8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd78c6971e144b59b38897f70e446ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:26Z,use_quota=True,user_id='f036959b39a2447da4a61ff8014d12da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Creating volume 6290a10b-6f27-4f38-9e32-dbf334ddb8ce {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:26 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=51, name=volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce 1073741824" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] <== create_volume: return (130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.133s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8328015-8e39-4740-beed-047fef5ffc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7dd0db-4a9d-4bd3-b296-4750a2d76e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:26 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Volume volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce (6290a10b-6f27-4f38-9e32-dbf334ddb8ce): created successfully
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7dd0db-4a9d-4bd3-b296-4750a2d76e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Flow 'volume_create_manager' (24c433e6-07d9-4218-9a08-a1a1541306a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-01c8c305-8b8a-4a65-bde5-dcb53b932739 tempest-VolumesTransfersV357Test-222760079 None] Created volume successfully.
Sep 30 15:42:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] GroupSnapshot d134eda9-6bfe-4412-9ed6-4880bf62b64e: creating.
Sep 30 15:42:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Group snapshot d134eda9-6bfe-4412-9ed6-4880bf62b64e: creating. {{(pid=80302) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Creating offline snapshot 662dbef3-832c-41f6-939c-1bc7dc6a6a4f of volume 7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa93f2-c494-45d9-974e-9c2ff4c3f0d4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=52, name=volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f 1G" returned: 0 in 0.091s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "qemu-img rebase -u -b volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.info" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.info" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.396s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d5e8ddc2-4d6a-46f7-8663-e8e653cb8ed5 tempest-GroupSnapshotsV319Test-425936091 None] group_snapshot d134eda9-6bfe-4412-9ed6-4880bf62b64e: created successfully
Sep 30 15:42:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4fb33acb-93b6-4a30-ae26-2981a31e55e2 tempest-VolumesTransfersV357Test-1365044836 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4fb33acb-93b6-4a30-ae26-2981a31e55e2 tempest-VolumesTransfersV357Test-1365044836 None] Transfer volume completed successfully.
Sep 30 15:42:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] group_snapshot d134eda9-6bfe-4412-9ed6-4880bf62b64e: deleting
Sep 30 15:42:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] group_snapshot d134eda9-6bfe-4412-9ed6-4880bf62b64e: deleting {{(pid=80302) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "cinder-quobyte-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Lock "cinder-quobyte-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "cinder-quobyte-662dbef3-832c-41f6-939c-1bc7dc6a6a4f" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Lock "cinder-quobyte-662dbef3-832c-41f6-939c-1bc7dc6a6a4f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Deleting offline snapshot 662dbef3-832c-41f6-939c-1bc7dc6a6a4f of volume 7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] snapshot_file for this snap is: volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ea0e0-8dc1-4915-b8e9-43ecffcab208]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c70f83f-ece0-437d-a4f1-40c3b738393d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" returned: 0 in 0.185s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Acquiring lock "cinder-6290a10b-6f27-4f38-9e32-dbf334ddb8ce-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-6290a10b-6f27-4f38-9e32-dbf334ddb8ce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Acquiring lock "cinder-quobyte-6290a10b-6f27-4f38-9e32-dbf334ddb8ce" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-quobyte-6290a10b-6f27-4f38-9e32-dbf334ddb8ce" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f" returned: 0 in 0.109s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5d3b4-15c0-41c9-996b-36156c81dd10]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0.662dbef3-832c-41f6-939c-1bc7dc6a6a4f" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Lock "cinder-quobyte-662dbef3-832c-41f6-939c-1bc7dc6a6a4f" released by "_delete_snapshot" :: held 0.526s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Lock "cinder-quobyte-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" released by "delete_snapshot" :: held 0.538s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:28 devstack cinder-volume[80302]: WARNING cinder.quota [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-629617779 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-629617779, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:28 devstack cinder-volume[80302]: WARNING cinder.quota [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-629617779 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-629617779, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] Created reservations ['3fd634be-adeb-4ea6-bdbd-46cdb7fd07a9', 'efd7b4a0-8270-4c36-8785-5020e4d2f62a', '5c1ba7df-dd1d-46d8-abf0-ffaa2a64b122', '7e44248e-a1cf-49a4-8f46-3fbfd468b799'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0217e106-f42c-4448-81c4-27f26146a690 tempest-GroupSnapshotsV319Test-425936091 None] group_snapshot d134eda9-6bfe-4412-9ed6-4880bf62b64e: deleted successfully
Sep 30 15:42:28 devstack quobyte-client[80089]: System call "getattr" of process 90968 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6290a10b-6f27-4f38-9e32-dbf334ddb8ce" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-quobyte-6290a10b-6f27-4f38-9e32-dbf334ddb8ce" released by "delete_volume" :: held 0.204s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Created reservations ['859e71db-8f4e-4b6f-b862-3d376a8ac0f4', '2f529e84-5f07-4453-963a-fa3a60099045', 'a53fbd35-e6ab-482b-b150-e4a02d95a6b4', '9a1d78b1-5f65-428b-b3ae-26116e60adde'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Deleted volume successfully.
Sep 30 15:42:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a9bf1dd7-7976-4fcd-9abd-7fd71d5ca253 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-6290a10b-6f27-4f38-9e32-dbf334ddb8ce-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "cinder-quobyte-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Lock "cinder-quobyte-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f26d9a8-b9e1-425f-8146-c48c4f0771aa]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" returned: 0 in 0.137s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Lock "cinder-quobyte-7b3a6e6e-e60e-494d-b5cb-fafa6f8041d0" released by "delete_volume" :: held 0.222s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Created reservations ['c97895e4-9d0f-4d1f-ab7c-f3d17efb7a7f'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:29 devstack cinder-volume[80302]: WARNING cinder.quota [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-629617779 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-629617779, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Created reservations ['2543231e-fdd2-414a-a494-74038d0a4cf0', '8ecd776c-48b1-44f1-93c6-abdbbc724bec', '79df97f7-6ce8-4a4d-86d5-41a452eb0710', '44518659-8fab-4223-b01d-0f9b4034c28c'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ab8f8a87-e196-4ba7-b39c-668e4dcad8de tempest-GroupSnapshotsV319Test-425936091 None] Delete group completed successfully.
Sep 30 15:42:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Flow 'volume_create_manager' (5fa8189b-a7a8-4caf-bf71-74ba1b659d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a028e912-60e3-4302-9732-7b4329966a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a028e912-60e3-4302-9732-7b4329966a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1580374567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd78c6971e144b59b38897f70e446ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:30Z,use_quota=True,user_id='f036959b39a2447da4a61ff8014d12da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c22970b-c1e9-4c28-a113-11e3ba73f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c22970b-c1e9-4c28-a113-11e3ba73f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520d2ec4-b628-4e50-b72d-460c1b7b61ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520d2ec4-b628-4e50-b72d-460c1b7b61ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd', 'volume_name': 'volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4e6372-aafb-4869-9ed6-cbe823614fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4e6372-aafb-4869-9ed6-cbe823614fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54c596c-3019-4645-9ec9-7fac77cf5922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Volume 0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd', 'volume_size': 1}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1580374567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd78c6971e144b59b38897f70e446ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:30Z,use_quota=True,user_id='f036959b39a2447da4a61ff8014d12da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Creating volume 0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:29 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:29 devstack quobyte-client[80089]: System call "open" of process 90979 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:29 devstack quobyte-client[80089]: System call "ioctl" of process 90979 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=54, name=volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd 1073741824" returned: 0 in 0.115s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] <== create_volume: return (142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.144s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54c596c-3019-4645-9ec9-7fac77cf5922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566ae45c-b44a-4a4f-9375-e2dd691ce43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Volume volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd (0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd): created successfully
Sep 30 15:42:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566ae45c-b44a-4a4f-9375-e2dd691ce43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Flow 'volume_create_manager' (5fa8189b-a7a8-4caf-bf71-74ba1b659d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5145b2bb-aed4-439d-93f2-d94c62b142c3 tempest-VolumesTransfersV357Test-222760079 None] Created volume successfully.
Sep 30 15:42:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Acquiring lock "cinder-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Acquiring lock "cinder-quobyte-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-quobyte-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0505c-208f-4049-89c7-d6148a1c3467]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-quobyte-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd" released by "delete_volume" :: held 0.201s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Created reservations ['ec1806c1-906c-48c9-b8bd-300c9521b71b', '0f25434e-54cc-4c37-9f40-686a97598fd8', '5ebd7e22-a1e2-4683-9ca9-aa6239275b47', 'f80db582-ee0d-44db-861e-1719e0fbe605'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Deleted volume successfully.
Sep 30 15:42:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dbfae6b9-87ad-47cc-8cf3-0dd2cf34cc62 tempest-VolumesTransfersV357Test-1546016568 None] Lock "cinder-0e0ae0c9-0f34-4a0a-ba0a-4e806029d6bd-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:33 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5b6a242f-3183-4e76-8bda-a47a9817b220 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5b6a242f-3183-4e76-8bda-a47a9817b220 tempest-GroupsTest-1543651546 None] Group tempest-Group1-1438267475: creating
Sep 30 15:42:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5b6a242f-3183-4e76-8bda-a47a9817b220 tempest-GroupsTest-1543651546 None] Group tempest-Group1-1438267475: created successfully
Sep 30 15:42:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5b6a242f-3183-4e76-8bda-a47a9817b220 tempest-GroupsTest-1543651546 None] Create group completed successfully.
Sep 30 15:42:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-274a18d4-239c-4a7d-ab12-420154c11fd6 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-274a18d4-239c-4a7d-ab12-420154c11fd6 tempest-GroupsTest-1543651546 None] Group tempest-Group2-549689864: creating
Sep 30 15:42:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-274a18d4-239c-4a7d-ab12-420154c11fd6 tempest-GroupsTest-1543651546 None] Group tempest-Group2-549689864: created successfully
Sep 30 15:42:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-274a18d4-239c-4a7d-ab12-420154c11fd6 tempest-GroupsTest-1543651546 None] Create group completed successfully.
Sep 30 15:42:36 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Flow 'volume_create_manager' (ea5bcfff-af0c-4703-b6b4-db19fd71a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a37af7-a9ab-4f9f-97e3-6e725d242321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a37af7-a9ab-4f9f-97e3-6e725d242321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1571748588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d7b7cb64-5586-413b-9e62-f384826eadf9,host='devstack@QuobyteHD#QuobyteHD',id=1be3c405-f559-4a33-bf7d-08f93db3700c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17c4d8fe7b941bf916365002b7d36c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:36Z,use_quota=True,user_id='844d670220e7400caf28be387200e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b600ed0e-652a-4c12-91e9-d98de0cedfcd),volume_type_id=b600ed0e-652a-4c12-91e9-d98de0cedfcd)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c31abe3-3970-4a8a-86d9-f997bcd92d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c31abe3-3970-4a8a-86d9-f997bcd92d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a81d2db-b09a-4f2e-85f0-dd1fcbd2c290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a81d2db-b09a-4f2e-85f0-dd1fcbd2c290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be3c405-f559-4a33-bf7d-08f93db3700c', 'volume_name': 'volume-1be3c405-f559-4a33-bf7d-08f93db3700c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376d8fdc-351b-40b4-8c1c-09ff6b277ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376d8fdc-351b-40b4-8c1c-09ff6b277ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baa3982-2a38-41fe-b20f-3ba02d08900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Volume 1be3c405-f559-4a33-bf7d-08f93db3700c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be3c405-f559-4a33-bf7d-08f93db3700c', 'volume_size': 1}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d7b7cb64-5586-413b-9e62-f384826eadf9,created_at=2025-09-30T13:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1571748588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d7b7cb64-5586-413b-9e62-f384826eadf9,host='devstack@QuobyteHD#QuobyteHD',id=1be3c405-f559-4a33-bf7d-08f93db3700c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17c4d8fe7b941bf916365002b7d36c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:36Z,use_quota=True,user_id='844d670220e7400caf28be387200e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b600ed0e-652a-4c12-91e9-d98de0cedfcd),volume_type_id=b600ed0e-652a-4c12-91e9-d98de0cedfcd)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Creating volume 1be3c405-f559-4a33-bf7d-08f93db3700c {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:36 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:36 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=55, name=volume-1be3c405-f559-4a33-bf7d-08f93db3700c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c 1073741824" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] <== create_volume: return (172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.175s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baa3982-2a38-41fe-b20f-3ba02d08900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be3c405-f559-4a33-bf7d-08f93db3700c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563829f3-15c9-4246-93ce-27c5a21c16c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Volume volume-1be3c405-f559-4a33-bf7d-08f93db3700c (1be3c405-f559-4a33-bf7d-08f93db3700c): created successfully
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563829f3-15c9-4246-93ce-27c5a21c16c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Flow 'volume_create_manager' (ea5bcfff-af0c-4703-b6b4-db19fd71a814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bf97dde0-df7e-4bc6-ba94-d04ab4752ec9 tempest-GroupsTest-1543651546 None] Created volume successfully.
Sep 30 15:42:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Acquiring lock "cinder-quobyte-1be3c405-f559-4a33-bf7d-08f93db3700c" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Lock "cinder-quobyte-1be3c405-f559-4a33-bf7d-08f93db3700c" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[17160ba9-8812-43d9-84eb-c1db17377831]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1be3c405-f559-4a33-bf7d-08f93db3700c" returned: 0 in 0.050s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Lock "cinder-quobyte-1be3c405-f559-4a33-bf7d-08f93db3700c" released by "delete_volume" :: held 0.221s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Created reservations ['ed323a83-6b6e-4086-9a63-e9502988db30'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:37 devstack cinder-volume[80302]: WARNING cinder.quota [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-426045545 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-426045545, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:37 devstack cinder-volume[80302]: WARNING cinder.quota [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-426045545 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-426045545, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Created reservations ['06c1efbb-90fe-4d0c-a1da-5102a2ae83ee', 'd0b9f63f-6e2f-437b-84a2-f9937b033250', 'b2b35cb2-52f9-466a-8511-e3820d2ed55c', '3e748de0-e183-4f79-8222-5409ce7bcc73'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:37 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7e501c95-78d8-4f09-8149-3164e2b80ef3 tempest-GroupsTest-1543651546 None] Delete group completed successfully.
Sep 30 15:42:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Created reservations ['a74e9085-5db5-40fb-bb6d-e28b874b7620'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:38 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-85fac6c6-b95b-4eb2-bd3a-b28ef8f7e72d tempest-GroupsTest-1543651546 None] Delete group completed successfully.
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0cf55cfc-ad18-413e-83d6-90899c3267ff tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0cf55cfc-ad18-413e-83d6-90899c3267ff tempest-GroupsTest-1543651546 None] Group tempest-GroupsTest-Group-1099209857: creating
Sep 30 15:42:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0cf55cfc-ad18-413e-83d6-90899c3267ff tempest-GroupsTest-1543651546 None] Group tempest-GroupsTest-Group-1099209857: created successfully
Sep 30 15:42:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0cf55cfc-ad18-413e-83d6-90899c3267ff tempest-GroupsTest-1543651546 None] Create group completed successfully.
Sep 30 15:42:41 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Flow 'volume_create_manager' (63865706-98d6-4650-b1ff-0e6da0fa69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa58e65-8f80-425e-8f1b-cb7ff439e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa58e65-8f80-425e-8f1b-cb7ff439e68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250661071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e85ed3ef-a18a-4488-aba1-1ce4d151c806,host='devstack@QuobyteHD#QuobyteHD',id=d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17c4d8fe7b941bf916365002b7d36c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:42Z,use_quota=True,user_id='844d670220e7400caf28be387200e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83ad996-f2c7-4dba-9862-2d0a353445c0),volume_type_id=e83ad996-f2c7-4dba-9862-2d0a353445c0)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee0c862-b728-4fbb-9dc1-a121f8e263c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee0c862-b728-4fbb-9dc1-a121f8e263c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45840dcf-fa5e-432b-9f3b-d94c28ff32a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45840dcf-fa5e-432b-9f3b-d94c28ff32a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c0bfdb-be0d-480e-a65c-0f2b238a6a8d', 'volume_name': 'volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249afd89-fe6d-4eff-b0bf-e6c2794cd579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249afd89-fe6d-4eff-b0bf-e6c2794cd579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17685439-2089-4c8d-b816-f53fedb1972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:41 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Volume d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d', 'volume_size': 1}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e85ed3ef-a18a-4488-aba1-1ce4d151c806,created_at=2025-09-30T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250661071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e85ed3ef-a18a-4488-aba1-1ce4d151c806,host='devstack@QuobyteHD#QuobyteHD',id=d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17c4d8fe7b941bf916365002b7d36c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:42Z,use_quota=True,user_id='844d670220e7400caf28be387200e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83ad996-f2c7-4dba-9862-2d0a353445c0),volume_type_id=e83ad996-f2c7-4dba-9862-2d0a353445c0)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Creating volume d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:41 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:41 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=56, name=volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d 1073741824" returned: 0 in 0.169s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] <== create_volume: return (223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.225s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17685439-2089-4c8d-b816-f53fedb1972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d430f3e-5ef4-4ea4-ac58-c7d08315178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:41 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Volume volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d (d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d): created successfully
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d430f3e-5ef4-4ea4-ac58-c7d08315178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:41 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Flow 'volume_create_manager' (63865706-98d6-4650-b1ff-0e6da0fa69de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:41 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a39c121c-1c2d-40bc-b735-ddb530fff5a3 tempest-GroupsTest-1543651546 None] Created volume successfully.
Sep 30 15:42:43 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Flow 'volume_create_manager' (3b67b150-a8a0-4627-b450-7f98dfb2f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3293642-59b5-4e17-abdc-1ed4ded73f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3293642-59b5-4e17-abdc-1ed4ded73f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2034247362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e85ed3ef-a18a-4488-aba1-1ce4d151c806,host='devstack@QuobyteHD#QuobyteHD',id=5dcb1bb4-3a2e-4401-8e23-7f6f7620b956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17c4d8fe7b941bf916365002b7d36c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:43Z,use_quota=True,user_id='844d670220e7400caf28be387200e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83ad996-f2c7-4dba-9862-2d0a353445c0),volume_type_id=e83ad996-f2c7-4dba-9862-2d0a353445c0)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d62771-bd04-45b7-a549-ef037e46c211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d62771-bd04-45b7-a549-ef037e46c211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca157c8-e93b-4de4-a105-24f027203458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca157c8-e93b-4de4-a105-24f027203458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcb1bb4-3a2e-4401-8e23-7f6f7620b956', 'volume_name': 'volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209ecd7b-78d1-4efd-8d63-54b75d7206d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209ecd7b-78d1-4efd-8d63-54b75d7206d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f125aa22-c08d-4dc7-a021-39c9c99e2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Volume 5dcb1bb4-3a2e-4401-8e23-7f6f7620b956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956', 'volume_size': 1}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e85ed3ef-a18a-4488-aba1-1ce4d151c806,created_at=2025-09-30T13:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2034247362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e85ed3ef-a18a-4488-aba1-1ce4d151c806,host='devstack@QuobyteHD#QuobyteHD',id=5dcb1bb4-3a2e-4401-8e23-7f6f7620b956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17c4d8fe7b941bf916365002b7d36c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:43Z,use_quota=True,user_id='844d670220e7400caf28be387200e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83ad996-f2c7-4dba-9862-2d0a353445c0),volume_type_id=e83ad996-f2c7-4dba-9862-2d0a353445c0)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Creating volume 5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:43 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=57, name=volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 1073741824" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] <== create_volume: return (167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.169s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f125aa22-c08d-4dc7-a021-39c9c99e2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ef62b0-4bd2-499d-8694-26c1b3453c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Volume volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 (5dcb1bb4-3a2e-4401-8e23-7f6f7620b956): created successfully
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ef62b0-4bd2-499d-8694-26c1b3453c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Flow 'volume_create_manager' (3b67b150-a8a0-4627-b450-7f98dfb2f681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-687858c7-54a3-4c8c-8827-df9f98da2089 tempest-GroupsTest-1543651546 None] Created volume successfully.
Sep 30 15:42:43 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Flow 'volume_create_manager' (181bb210-f4df-43ef-8ef6-a21922c95893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ae9145-0f68-42a7-be9f-ee69f5669d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ae9145-0f68-42a7-be9f-ee69f5669d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1966287170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4c0c67-bad9-49f7-ad16-51a3f504c8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8aa3bb349d4b7798f49af19cf94463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:43Z,use_quota=True,user_id='64535b9e143c41dcb896f3d1a9e67879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a54c9b5-fae1-4387-91bb-400da7b0b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a54c9b5-fae1-4387-91bb-400da7b0b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b48ac1-1714-417e-b152-68c6b7928fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b48ac1-1714-417e-b152-68c6b7928fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4c0c67-bad9-49f7-ad16-51a3f504c8d0', 'volume_name': 'volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0f47dc-ca96-4cfe-ad3e-a833252bd700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0f47dc-ca96-4cfe-ad3e-a833252bd700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14225ce-9d25-4dd4-a18d-6138252013c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Volume cb4c0c67-bad9-49f7-ad16-51a3f504c8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0', 'volume_size': 1}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1966287170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4c0c67-bad9-49f7-ad16-51a3f504c8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8aa3bb349d4b7798f49af19cf94463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:43Z,use_quota=True,user_id='64535b9e143c41dcb896f3d1a9e67879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Creating volume cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:43 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=58, name=volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:43 devstack quobyte-client[80089]: System call "getattr" of process 91022 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:43 devstack quobyte-client[80089]: System call "open" of process 91022 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 1073741824" returned: 0 in 0.104s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] <== create_volume: return (128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.130s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14225ce-9d25-4dd4-a18d-6138252013c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6fc61c-36bf-4321-b584-dcac8e0c9027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Volume volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 (cb4c0c67-bad9-49f7-ad16-51a3f504c8d0): created successfully
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6fc61c-36bf-4321-b584-dcac8e0c9027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:43 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Flow 'volume_create_manager' (181bb210-f4df-43ef-8ef6-a21922c95893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:43 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-71f694fb-637b-4947-b7d8-9564e3d20d24 tempest-VolumesActionsTest-1265505454 None] Created volume successfully.
Sep 30 15:42:44 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f6d22908-65ff-4c4c-9060-b2fbaae59a50 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f6d22908-65ff-4c4c-9060-b2fbaae59a50 tempest-GroupsTest-1543651546 None] Update group completed successfully.
Sep 30 15:42:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:45 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bc3801c0-3008-42c0-a62e-b9a3ebec40a1 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:45 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bc3801c0-3008-42c0-a62e-b9a3ebec40a1 tempest-GroupsTest-1543651546 None] Update group completed successfully.
Sep 30 15:42:46 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Acquiring lock "cinder-quobyte-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Lock "cinder-quobyte-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[04796ba5-7c76-4ecc-9eba-8650d37424b2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Lock "cinder-quobyte-5dcb1bb4-3a2e-4401-8e23-7f6f7620b956" released by "delete_volume" :: held 0.188s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Acquiring lock "cinder-quobyte-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Lock "cinder-quobyte-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e6ff02-db12-4f84-aaa1-c3271cac6816]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Lock "cinder-quobyte-d0c0bfdb-be0d-480e-a65c-0f2b238a6a8d" released by "delete_volume" :: held 0.176s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Created reservations ['17caccb4-23c7-4413-b007-01f97b4ff943'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:47 devstack cinder-volume[80302]: WARNING cinder.quota [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1428588992 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1428588992, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:47 devstack cinder-volume[80302]: WARNING cinder.quota [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1428588992 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1428588992, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Created reservations ['9e45a11b-4b40-48e5-b587-7cdcb2808a79', '44d45c81-8334-4df4-922c-83defcb61e0e', '48714906-f3e6-42a9-92e2-bd9d9bff424b', 'aa95dbb7-dd92-403f-a465-2dfdc37b4726'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Created reservations ['818e8565-43f2-4699-a23a-4d8053f9b95e', 'e2a34396-4d53-41cb-aab8-8e72bd9576ca', 'c7ce9093-410b-4fcc-b6a5-8c2924ef1e98', '5ada3740-80d7-4f91-8586-26b949d1fdcd'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:47 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:47 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e877e985-21c2-47dc-8e25-3a717e2a5d17 tempest-GroupsTest-1543651546 None] Delete group completed successfully.
Sep 30 15:42:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=140,cinder:UPDATE=167,cinder:DELETE=9,cinder:INSERT=32 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:42:51 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-8d7bdbed-67ba-4ef7-bdf2-6017382f2d7e tempest-GroupsV320Test-225826891 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8d7bdbed-67ba-4ef7-bdf2-6017382f2d7e tempest-GroupsV320Test-225826891 None] Group tempest-GroupsV320Test-Group-1047071734: creating
Sep 30 15:42:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=181,cinder:SELECT=136,cinder:INSERT=38,cinder:DELETE=15 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:42:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8d7bdbed-67ba-4ef7-bdf2-6017382f2d7e tempest-GroupsV320Test-225826891 None] Group tempest-GroupsV320Test-Group-1047071734: created successfully
Sep 30 15:42:51 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8d7bdbed-67ba-4ef7-bdf2-6017382f2d7e tempest-GroupsV320Test-225826891 None] Create group completed successfully.
Sep 30 15:42:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Created reservations ['56e5aef3-d59e-4ce5-801e-a7e6db85c915'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:52 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:42:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-af704e48-fa37-468c-a7c4-39e41f14a4a0 tempest-GroupsV320Test-225826891 None] Delete group completed successfully.
Sep 30 15:42:57 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Flow 'volume_create_manager' (c096c374-c71f-49b5-bb10-4870d6e6a10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a186e7-549a-45c5-ba08-d53a183456c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a186e7-549a-45c5-ba08-d53a183456c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-359004866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1ccd91-1f0c-412d-9c26-f81a584957e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0572694b8de1401da8b2c8b8cac4fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:57Z,use_quota=True,user_id='632ecc939d174e908ae4703c9f91d2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cc2d0b-1c1c-49fb-8b7c-455c3c1f6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cc2d0b-1c1c-49fb-8b7c-455c3c1f6d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1290d8cc-cfba-45e8-af2f-f39ea2c6165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1290d8cc-cfba-45e8-af2f-f39ea2c6165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1ccd91-1f0c-412d-9c26-f81a584957e0', 'volume_name': 'volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40b8095-49cc-4e9f-afef-33d009c340a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40b8095-49cc-4e9f-afef-33d009c340a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a1c40d-86fa-4936-9a9f-34f53f1f97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:57 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0', 'volume_size': 1}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-359004866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1ccd91-1f0c-412d-9c26-f81a584957e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0572694b8de1401da8b2c8b8cac4fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:42:57Z,use_quota=True,user_id='632ecc939d174e908ae4703c9f91d2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Creating volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:42:57 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:57 devstack quobyte-client[80089]: System call "getlk" of process 91145 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:57 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=59, name=volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 1073741824" returned: 0 in 0.176s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] <== create_volume: return (217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.219s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a1c40d-86fa-4936-9a9f-34f53f1f97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e282df32-b017-4caa-93a3-7aa9f7e8387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:42:57 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Volume volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 (0f1ccd91-1f0c-412d-9c26-f81a584957e0): created successfully
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e282df32-b017-4caa-93a3-7aa9f7e8387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:42:57 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Flow 'volume_create_manager' (c096c374-c71f-49b5-bb10-4870d6e6a10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:42:57 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e09f3d4c-f80e-4642-a62c-fa1a0ad263c8 tempest-SnapshotsActionsTest-506975691 None] Created volume successfully.
Sep 30 15:42:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Creating offline snapshot 770d6a73-b735-4fa9-a348-0d3d2cbdd26e of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16afd77-bdca-41e8-be50-9a66782a28a2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0" returned: 0 in 0.157s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=60, name=volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e 1G" returned: 0 in 0.105s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.046s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.info" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.info" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.460s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:42:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6195b7f7-e4c7-4f78-bf20-db10eb778c12 tempest-SnapshotsActionsTest-506975691 None] Create snapshot completed successfully
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9c935683-c609-482e-97af-5346fd830549 tempest-VolumesActionsTest-1265505454 None] Acquiring lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" by "attach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9c935683-c609-482e-97af-5346fd830549 tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" acquired by "attach_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:42:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-9c935683-c609-482e-97af-5346fd830549 tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9c935683-c609-482e-97af-5346fd830549 tempest-VolumesActionsTest-1265505454 None] Attaching volume cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 to instance 2eac5bc9-7ce9-4b16-a378-9c12e1a2fff7 at mountpoint /dev/vdb on host None.
Sep 30 15:42:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9c935683-c609-482e-97af-5346fd830549 tempest-VolumesActionsTest-1265505454 None] Attach volume completed successfully.
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9c935683-c609-482e-97af-5346fd830549 tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" released by "attach_volume" :: held 0.090s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:42:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Creating offline snapshot 0421ce2e-c790-4608-97c6-4f957a5c2297 of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e35950-b736-4c5a-af9a-1b5be2d2f551]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:59 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=62, name=volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 1G" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:59 devstack quobyte-client[80089]: System call "getattr" of process 91179 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297" returned: 0 in 0.049s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:42:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:42:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297" returned: 0 in 0.043s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.462s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Acquiring lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-detach_volume" by "detach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b952f4a6-945a-4cc8-82c2-bc083d5cac65 tempest-SnapshotsActionsTest-506975691 None] Create snapshot completed successfully
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Detaching volume cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 from instance 2eac5bc9-7ce9-4b16-a378-9c12e1a2fff7.
Sep 30 15:43:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Detach volume completed successfully.
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6a4d58ce-d904-4372-984c-cbdc4c7093a1 tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-0421ce2e-c790-4608-97c6-4f957a5c2297-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-0421ce2e-c790-4608-97c6-4f957a5c2297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-0421ce2e-c790-4608-97c6-4f957a5c2297" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0421ce2e-c790-4608-97c6-4f957a5c2297" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Deleting offline snapshot 0421ce2e-c790-4608-97c6-4f957a5c2297 of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] snapshot_file for this snap is: volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c73ee5-64fd-45d7-bfa8-b570e91728d1]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297" returned: 0 in 0.164s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[453ad3ee-c892-4561-b9bb-ffcc726764df]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.137s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297" returned: 0 in 0.093s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.0421ce2e-c790-4608-97c6-4f957a5c2297" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0421ce2e-c790-4608-97c6-4f957a5c2297" released by "_delete_snapshot" :: held 0.511s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" released by "delete_snapshot" :: held 0.529s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Created reservations ['f8f18887-cd5e-4a36-a939-343c571c565c', '1eca21a4-e639-472f-b61b-65cd8a020524', '41919872-9d88-4b43-939f-aeecb47dada1', 'e9c3c655-15c7-43c0-bc68-b53d219418db'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:01 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Delete snapshot completed successfully.
Sep 30 15:43:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-979a0661-6632-4932-9784-9fd35007005d tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-0421ce2e-c790-4608-97c6-4f957a5c2297-delete_snapshot" released by "delete_snapshot" :: held 0.630s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Creating offline snapshot e715aafe-bfe9-42ec-815f-eb7979451465 of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a302ef74-2e3a-4131-bee6-2a89f270076e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:02 devstack quobyte-client[80089]: System call "open" of process 91218 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.320s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:02 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=63, name=volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 1G" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465" returned: 0 in 0.051s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465" returned: 0 in 0.069s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.715s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-026f4a0b-4f6f-4a00-b700-b676495e317f tempest-SnapshotsActionsTest-506975691 None] Create snapshot completed successfully
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-e715aafe-bfe9-42ec-815f-eb7979451465-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-e715aafe-bfe9-42ec-815f-eb7979451465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:03 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-e715aafe-bfe9-42ec-815f-eb7979451465" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-e715aafe-bfe9-42ec-815f-eb7979451465" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Deleting offline snapshot e715aafe-bfe9-42ec-815f-eb7979451465 of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] snapshot_file for this snap is: volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e11e69-5758-4081-902c-647a4ad4a402]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84428a2-1154-40ea-af1b-c85f48af9df5]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465" returned: 0 in 0.114s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.e715aafe-bfe9-42ec-815f-eb7979451465" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-e715aafe-bfe9-42ec-815f-eb7979451465" released by "_delete_snapshot" :: held 0.495s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" released by "delete_snapshot" :: held 0.509s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:03 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Created reservations ['e2dea2df-5e2c-4edc-8c4d-f21f62aafc7e', 'a5ec5c58-bf12-4443-a4cb-4dbe723d0142', '480b6556-56d7-487a-a601-394da686d427', '5210659a-d76a-42f4-8092-d2901c5d4dea'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Delete snapshot completed successfully.
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6571ad8e-ac5d-4604-a5db-21753ba47aeb tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-e715aafe-bfe9-42ec-815f-eb7979451465-delete_snapshot" released by "delete_snapshot" :: held 0.593s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Creating offline snapshot ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[24288249-98f3-4463-ae2b-061bd1c820ab]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:04 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=64, name=volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 1G" returned: 0 in 0.109s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.388s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1c04722e-b75e-47d8-ba63-c27da9b47a21 tempest-SnapshotsActionsTest-506975691 None] Create snapshot completed successfully
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Deleting offline snapshot ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] snapshot_file for this snap is: volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6def47-dbe5-45bb-86f0-43116887e3f3]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e94622-bcd4-4865-80fd-a6754ddeb5a3]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:06 devstack quobyte-client[80089]: System call "open" of process 91340 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" returned: 0 in 0.083s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2" released by "_delete_snapshot" :: held 0.429s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" released by "delete_snapshot" :: held 0.446s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Created reservations ['64abcc33-14b9-4382-8bfc-5c2047ed9f5c', '00c470a9-cc08-4482-9f84-7aae38c54e78', 'c04ff30e-8b35-48cc-835b-e876706a2c4a', '91bda480-a8fc-4bd6-bbac-eeb677cbe68e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Delete snapshot completed successfully.
Sep 30 15:43:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e187f18f-6a1f-4909-8fe3-f2fae35b4910 tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-ca71e1a8-6aa8-4b4c-b6a7-d9f2544f38e2-delete_snapshot" released by "delete_snapshot" :: held 0.531s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:07 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Creating offline snapshot 75501e00-e0e3-4ec8-9732-bca49f859aac of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0dd5ce-8178-4a18-b12f-d91ab7e6accf]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.135s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:07 devstack quobyte-client[80089]: System call "getattr" of process 91347 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:07 devstack quobyte-client[80089]: System call "open" of process 91347 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:07 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=65, name=volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac 1G" returned: 0 in 0.101s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img rebase -u -b volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.359s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:07 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-82ae9f40-174e-46ec-b498-36800991108f tempest-SnapshotsActionsTest-506975691 None] Create snapshot completed successfully
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-75501e00-e0e3-4ec8-9732-bca49f859aac-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-75501e00-e0e3-4ec8-9732-bca49f859aac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Acquiring lock "cinder-quobyte-75501e00-e0e3-4ec8-9732-bca49f859aac" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-75501e00-e0e3-4ec8-9732-bca49f859aac" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Deleting offline snapshot 75501e00-e0e3-4ec8-9732-bca49f859aac of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] snapshot_file for this snap is: volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa94218-089c-4934-84f6-b58249383a24]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f91b0ee-075f-4fb5-9dc6-5d38b4beb83d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:08 devstack quobyte-client[80089]: System call "getlk" of process 91361 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.75501e00-e0e3-4ec8-9732-bca49f859aac" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-75501e00-e0e3-4ec8-9732-bca49f859aac" released by "_delete_snapshot" :: held 0.501s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" released by "delete_snapshot" :: held 0.516s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Created reservations ['f9ff3e40-17f5-4b0f-8332-2434400c884b', 'd8e9c6d0-d48a-4503-a14e-b2ab3d180fa5', 'dad3b2ed-8060-43f2-8a2c-2cabf6eb1157', 'c4ebd52d-00ce-4784-a6ec-68d1b3bc3586'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Delete snapshot completed successfully.
Sep 30 15:43:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dfddf0b7-be57-445a-a917-80627a37146b tempest-SnapshotsActionsTest-522260757 None] Lock "cinder-75501e00-e0e3-4ec8-9732-bca49f859aac-delete_snapshot" released by "delete_snapshot" :: held 0.606s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "cinder-770d6a73-b735-4fa9-a348-0d3d2cbdd26e-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-770d6a73-b735-4fa9-a348-0d3d2cbdd26e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "cinder-quobyte-770d6a73-b735-4fa9-a348-0d3d2cbdd26e" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-quobyte-770d6a73-b735-4fa9-a348-0d3d2cbdd26e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Deleting offline snapshot 770d6a73-b735-4fa9-a348-0d3d2cbdd26e of volume 0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] snapshot_file for this snap is: volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5fb73-7b21-47d3-948b-b5553795a566]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c074a-d38b-4f01-b7b8-cf1b45ffdb62]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:10 devstack quobyte-client[80089]: System call "getattr" of process 91378 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.104s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0.770d6a73-b735-4fa9-a348-0d3d2cbdd26e" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-quobyte-770d6a73-b735-4fa9-a348-0d3d2cbdd26e" released by "_delete_snapshot" :: held 0.482s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" released by "delete_snapshot" :: held 0.496s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Created reservations ['8731428b-3266-46cd-9ef0-973966e8bd5d', 'edf3f13d-e852-4aff-81d5-e8fe0f5a0d14', '69adc972-cd63-4b7f-ae8c-3d12b684d4f6', '54816cb9-066b-4d0e-b482-17eb12c75178'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Delete snapshot completed successfully.
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0350ddd4-6b3c-45e2-904e-8414d8f8f930 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-770d6a73-b735-4fa9-a348-0d3d2cbdd26e-delete_snapshot" released by "delete_snapshot" :: held 0.581s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "cinder-0f1ccd91-1f0c-412d-9c26-f81a584957e0-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-0f1ccd91-1f0c-412d-9c26-f81a584957e0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3d460-639b-4433-a1ae-afd905751cb3]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0" returned: 0 in 0.159s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0f1ccd91-1f0c-412d-9c26-f81a584957e0" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-quobyte-0f1ccd91-1f0c-412d-9c26-f81a584957e0" released by "delete_volume" :: held 0.248s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Created reservations ['a02658ee-b12f-4295-abd5-702f8ca7ae5b', '6da25b23-87df-41cf-a960-d6837a49b8a1', 'f8f4edef-ee04-4265-9ed1-ae13b0e6baac', '4446ac34-a14c-4125-86c3-738a774e750a'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:43:11 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Deleted volume successfully.
Sep 30 15:43:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c4381357-bbb0-4a30-87c9-54071549ac65 tempest-SnapshotsActionsTest-506975691 None] Lock "cinder-0f1ccd91-1f0c-412d-9c26-f81a584957e0-delete_volume" released by "delete_volume" :: held 0.375s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Flow 'volume_create_manager' (af3b2d0e-36f9-4cc4-ade1-dbe0fb5b3aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76425123-45c1-406a-b1a8-cc547ca3303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76425123-45c1-406a-b1a8-cc547ca3303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1197503581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd083c0-ee16-42a5-8c63-8ec46f7df94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8678c65ff51d4455bbb8e4ea5b6e5bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:19Z,use_quota=True,user_id='7efeab71fd7d410cb639656c7db879c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943156f9-1b84-4d48-9a9b-4c6d0519eb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943156f9-1b84-4d48-9a9b-4c6d0519eb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea46df3-c362-402c-b221-1818bc1a8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea46df3-c362-402c-b221-1818bc1a8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd083c0-ee16-42a5-8c63-8ec46f7df94f', 'volume_name': 'volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d049f72-3d08-4d83-9c5c-b46131a91639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d049f72-3d08-4d83-9c5c-b46131a91639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cdf93a-c634-4968-bf78-d6590d922076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume 6cd083c0-ee16-42a5-8c63-8ec46f7df94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f', 'volume_size': 1}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1197503581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd083c0-ee16-42a5-8c63-8ec46f7df94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8678c65ff51d4455bbb8e4ea5b6e5bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:19Z,use_quota=True,user_id='7efeab71fd7d410cb639656c7db879c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Creating volume 6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:43:18 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:18 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=66, name=volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f 1073741824" returned: 0 in 0.120s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] <== create_volume: return (146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.148s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cdf93a-c634-4968-bf78-d6590d922076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f654e4-ff81-4541-a3e9-6d13bc76b7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f (6cd083c0-ee16-42a5-8c63-8ec46f7df94f): created successfully
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f654e4-ff81-4541-a3e9-6d13bc76b7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Flow 'volume_create_manager' (af3b2d0e-36f9-4cc4-ade1-dbe0fb5b3aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c07407b3-a702-49ab-8377-90565139e414 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Created volume successfully.
Sep 30 15:43:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Creating offline snapshot acf4e078-3617-4482-818b-303d6456ff64 of volume 6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[94140d27-6940-4c16-9db5-ac78c1347dfc]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:20 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=67, name=volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 1G" returned: 0 in 0.101s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "qemu-img rebase -u -b volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.info" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.info" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.402s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0b55479c-4348-414b-af18-cd737ad2b9dd tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Create snapshot completed successfully
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "cinder-acf4e078-3617-4482-818b-303d6456ff64-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-acf4e078-3617-4482-818b-303d6456ff64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "cinder-quobyte-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-quobyte-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "cinder-quobyte-acf4e078-3617-4482-818b-303d6456ff64" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-quobyte-acf4e078-3617-4482-818b-303d6456ff64" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Deleting offline snapshot acf4e078-3617-4482-818b-303d6456ff64 of volume 6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] snapshot_file for this snap is: volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e256b7f-4165-48e4-8342-a09555acb4da]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf257f-a051-4f89-8e76-046a6e1e3ec9]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:21 devstack quobyte-client[80089]: System call "getattr" of process 91530 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64" returned: 0 in 0.110s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f.acf4e078-3617-4482-818b-303d6456ff64" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-quobyte-acf4e078-3617-4482-818b-303d6456ff64" released by "_delete_snapshot" :: held 0.492s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-quobyte-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" released by "delete_snapshot" :: held 0.503s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Created reservations ['76e1782f-415c-47b7-af4a-9e1875256aab', '66e381ae-349c-4fbd-a49a-851c9fb0d414', '84210d83-5152-46ab-8eb6-5014ea56ea75', '06725895-def4-4d08-a43d-dd7ee837a0f0'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Delete snapshot completed successfully.
Sep 30 15:43:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-74bc3fd7-1e28-4e5b-aa2f-3f7ed64877b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-acf4e078-3617-4482-818b-303d6456ff64-delete_snapshot" released by "delete_snapshot" :: held 0.582s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "cinder-6cd083c0-ee16-42a5-8c63-8ec46f7df94f-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-6cd083c0-ee16-42a5-8c63-8ec46f7df94f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "cinder-quobyte-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-quobyte-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2fe12-b1b4-430a-84e8-b9826ac3e363]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:22 devstack quobyte-client[80089]: System call "open" of process 91538 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-quobyte-6cd083c0-ee16-42a5-8c63-8ec46f7df94f" released by "delete_volume" :: held 0.194s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Created reservations ['0c5be15e-ab44-47bf-95aa-bef85e9992b0', 'f97993c7-e591-40f0-bc77-d5cc2e9368c3', '9029664b-0f9d-42c9-b0b3-7676c408e7b0', 'aa0b866c-2242-4796-8c14-ff13f0e37b8b'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:43:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Deleted volume successfully.
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1bb1b259-b166-4537-aafd-8068e7426107 tempest-VolumeSnapshotQuotasNegativeTestJSON-490621151 None] Lock "cinder-6cd083c0-ee16-42a5-8c63-8ec46f7df94f-delete_volume" released by "delete_volume" :: held 0.363s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-972c7ff0-a497-48a8-b729-be1655e28095 tempest-VolumesActionsTest-1265505454 None] Acquiring lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" by "attach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-972c7ff0-a497-48a8-b729-be1655e28095 tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" acquired by "attach_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-972c7ff0-a497-48a8-b729-be1655e28095 tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-972c7ff0-a497-48a8-b729-be1655e28095 tempest-VolumesActionsTest-1265505454 None] Attaching volume cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 to instance bd997ab2-0d67-4938-b865-3f6059e7805e at mountpoint /dev/vdb on host None.
Sep 30 15:43:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-972c7ff0-a497-48a8-b729-be1655e28095 tempest-VolumesActionsTest-1265505454 None] Attach volume completed successfully.
Sep 30 15:43:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-972c7ff0-a497-48a8-b729-be1655e28095 tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" released by "attach_volume" :: held 0.051s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Acquiring lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-detach_volume" by "detach_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-detach_volume" acquired by "detach_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Detaching volume cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 from instance bd997ab2-0d67-4938-b865-3f6059e7805e.
Sep 30 15:43:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Detach volume completed successfully.
Sep 30 15:43:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cf54d98e-fc2f-4e14-8802-24cb60e1655c tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:24 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Flow 'volume_create_manager' (d8f05d9d-7a68-4466-ac25-a248f5c7e830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a711fbf-a4b9-462d-bd0a-813ab4b87ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a711fbf-a4b9-462d-bd0a-813ab4b87ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-355467453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3bff706-3ecb-4a86-90f2-5456dbbdc79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce52ef850324caf9d088e0f6462c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:25Z,use_quota=True,user_id='9b8bd0d0918b4ee0861a63f4d46f5af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e455e2-3820-4cd6-b353-c78cbe77a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e455e2-3820-4cd6-b353-c78cbe77a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffd2c0e-ed5a-47d2-9352-9acb9a15d3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffd2c0e-ed5a-47d2-9352-9acb9a15d3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3bff706-3ecb-4a86-90f2-5456dbbdc79b', 'volume_name': 'volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f19f7c6-7329-432b-88ce-b11b9e52c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f19f7c6-7329-432b-88ce-b11b9e52c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89606dc-93bd-4387-9842-75c2efc359ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:24 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Volume c3bff706-3ecb-4a86-90f2-5456dbbdc79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b', 'volume_size': 1}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-355467453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3bff706-3ecb-4a86-90f2-5456dbbdc79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce52ef850324caf9d088e0f6462c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:25Z,use_quota=True,user_id='9b8bd0d0918b4ee0861a63f4d46f5af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Creating volume c3bff706-3ecb-4a86-90f2-5456dbbdc79b {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:43:24 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:24 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=69, name=volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b 1073741824" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] <== create_volume: return (199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.201s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89606dc-93bd-4387-9842-75c2efc359ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e5269a-8a08-46af-8701-bbebfa10a23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:24 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Volume volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b (c3bff706-3ecb-4a86-90f2-5456dbbdc79b): created successfully
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e5269a-8a08-46af-8701-bbebfa10a23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:24 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Flow 'volume_create_manager' (d8f05d9d-7a68-4466-ac25-a248f5c7e830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:24 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bdaffda7-6aef-4935-b07d-d1cc902271d1 tempest-AttachVolumeTestJSON-972140354 None] Created volume successfully.
Sep 30 15:43:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Flow 'volume_create_manager' (aca6daaa-222c-4531-ba10-b9918060c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc112a4-348d-403d-902f-3b8ce4d958a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc112a4-348d-403d-902f-3b8ce4d958a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-681807092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1030b5f2-96f6-4960-a52e-86b30be9feaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8634d83b4aee49aeb43084022b7eec1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:27Z,use_quota=True,user_id='408b305c4edc46e0af20e709d4d677b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9ff7747-e86e-47cc-9ec5-7c54a2458347),volume_type_id=c9ff7747-e86e-47cc-9ec5-7c54a2458347)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282a5130-1452-4ef9-9e26-749d3ba26e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282a5130-1452-4ef9-9e26-749d3ba26e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f605599-da93-4ee9-83da-9bb0745164fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f605599-da93-4ee9-83da-9bb0745164fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1030b5f2-96f6-4960-a52e-86b30be9feaf', 'volume_name': 'volume-1030b5f2-96f6-4960-a52e-86b30be9feaf', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdba0321-20a9-4773-a93b-ea2372d1fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdba0321-20a9-4773-a93b-ea2372d1fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185b7225-9b84-4e7a-908b-d9c807d5471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Volume 1030b5f2-96f6-4960-a52e-86b30be9feaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1030b5f2-96f6-4960-a52e-86b30be9feaf', 'volume_size': 1}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-681807092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1030b5f2-96f6-4960-a52e-86b30be9feaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8634d83b4aee49aeb43084022b7eec1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:27Z,use_quota=True,user_id='408b305c4edc46e0af20e709d4d677b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9ff7747-e86e-47cc-9ec5-7c54a2458347),volume_type_id=c9ff7747-e86e-47cc-9ec5-7c54a2458347)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Creating volume 1030b5f2-96f6-4960-a52e-86b30be9feaf {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:43:27 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:27 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=70, name=volume-1030b5f2-96f6-4960-a52e-86b30be9feaf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf 1073741824" returned: 0 in 0.117s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] <== create_volume: return (140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.142s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185b7225-9b84-4e7a-908b-d9c807d5471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1030b5f2-96f6-4960-a52e-86b30be9feaf', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7412cf-a79d-4b2c-95b5-6301aea6aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Volume volume-1030b5f2-96f6-4960-a52e-86b30be9feaf (1030b5f2-96f6-4960-a52e-86b30be9feaf): created successfully
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7412cf-a79d-4b2c-95b5-6301aea6aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Flow 'volume_create_manager' (aca6daaa-222c-4531-ba10-b9918060c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f7fd8d92-0284-430f-a93f-db3895ef6960 tempest-VolumeTypesAccessTest-1445116961 None] Created volume successfully.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Acquiring lock "cinder-1030b5f2-96f6-4960-a52e-86b30be9feaf-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Lock "cinder-1030b5f2-96f6-4960-a52e-86b30be9feaf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Acquiring lock "cinder-quobyte-1030b5f2-96f6-4960-a52e-86b30be9feaf" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Lock "cinder-quobyte-1030b5f2-96f6-4960-a52e-86b30be9feaf" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[378cdf3f-f6bd-4712-b2e3-f7a1ebd99046]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[291cae0f-01cb-43b1-92cb-2a6f2d071e99]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:28 devstack quobyte-client[80089]: System call "statfs" of process 91609 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1030b5f2-96f6-4960-a52e-86b30be9feaf" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.156s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Lock "cinder-quobyte-1030b5f2-96f6-4960-a52e-86b30be9feaf" released by "delete_volume" :: held 0.198s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:28 devstack cinder-volume[80302]: WARNING cinder.quota [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-17300599 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-17300599, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:43:28 devstack cinder-volume[80302]: WARNING cinder.quota [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-17300599 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-17300599, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea1ba6e8-1b39-4aa3-a984-db724889fafa', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:43:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Created reservations ['192de4c5-b6af-4201-8724-8eb8b4abdfd7', 'afed2240-c467-4fd1-9cc8-4d25a5026f22', '6c68b963-86af-4515-85ed-91c7d28a6085', '91d491f4-fcb9-48eb-97a5-941bd4646d31'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-a9b2150e-c384-42fe-a314-edd7b91ef979 req-e1db9f50-63aa-471d-995b-a6733393b78c tempest-AttachVolumeTestJSON-972140354 None] attachment_update completed successfully.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:43:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Deleted volume successfully.
Sep 30 15:43:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bd9ce955-e46b-4d33-a1b1-839fe3363a23 tempest-VolumeTypesAccessTest-1445116961 None] Lock "cinder-1030b5f2-96f6-4960-a52e-86b30be9feaf-delete_volume" released by "delete_volume" :: held 0.366s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c043997-8e31-4123-aaca-a75b69063a4c]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.163s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:33 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b529c-bd9d-495e-9a61-0de756ab42d8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.172s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.98a7dee4-d777-435a-90d4-9e449faaec76be871msz.img {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:33 devstack quobyte-client[80089]: System call "getattr" of process 92011 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:33 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:33 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Flow 'volume_create_manager' (a8cc4ee1-4cb3-49f5-b4f7-f42f87253dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6c3414-4313-4a59-a3c8-b5a3d5a7628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6c3414-4313-4a59-a3c8-b5a3d5a7628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211957062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cedaa39-13db-47b1-9885-201be8d77a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce52ef850324caf9d088e0f6462c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:34Z,use_quota=True,user_id='9b8bd0d0918b4ee0861a63f4d46f5af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596381e6-ed4e-46cd-940e-66fb5c127bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596381e6-ed4e-46cd-940e-66fb5c127bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0123941-49b5-4538-b2c3-1bb4b9ae61eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0123941-49b5-4538-b2c3-1bb4b9ae61eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cedaa39-13db-47b1-9885-201be8d77a8c', 'volume_name': 'volume-0cedaa39-13db-47b1-9885-201be8d77a8c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e285a450-973a-446f-a8ca-3b2d7feb27d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e285a450-973a-446f-a8ca-3b2d7feb27d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cb4ee7-f165-4e41-81a6-b68e17c38e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:34 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Volume 0cedaa39-13db-47b1-9885-201be8d77a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cedaa39-13db-47b1-9885-201be8d77a8c', 'volume_size': 1}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.98a7dee4-d777-435a-90d4-9e449faaec76be871msz.img" returned: 0 in 1.624s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a45c5ef-d82b-423d-91c3-9b0b228c5260]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.293s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:35 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Image conversion details: src /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0, size 1024.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.98a7dee4-d777-435a-90d4-9e449faaec76be871msz.img {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:43:35 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Converted 1024.00 MB image at 630.35 MB/s
Sep 30 15:43:35 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] 98a7dee4-d777-435a-90d4-9e449faaec76 was raw, no need to convert to raw {{(pid=80302) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 30 15:43:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Flow 'volume_create_manager' (7d785bbe-6d18-4afe-a365-b40781e7e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c733a6d-33db-4076-925d-d0aec7bb7286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c733a6d-33db-4076-925d-d0aec7bb7286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1421213844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62afe726-8538-4c30-a92c-d5eff2c96d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1880410fa84047d28f97024e47686250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:36Z,use_quota=True,user_id='40c5605449774feab701448797af9b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f2942f-1370-4539-8051-1f548f9ab276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f2942f-1370-4539-8051-1f548f9ab276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cf50b7-3a1f-4fcd-8b44-f6b0868e78f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cf50b7-3a1f-4fcd-8b44-f6b0868e78f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62afe726-8538-4c30-a92c-d5eff2c96d00', 'volume_name': 'volume-62afe726-8538-4c30-a92c-d5eff2c96d00', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ebd751-e51c-49b0-bd97-99c69b8d1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ebd751-e51c-49b0-bd97-99c69b8d1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e701ee77-6cef-4bb8-a79d-c7949d121a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Volume 62afe726-8538-4c30-a92c-d5eff2c96d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62afe726-8538-4c30-a92c-d5eff2c96d00', 'volume_size': 1}
Sep 30 15:43:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.347s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Uploaded volume to glance image-id: 98a7dee4-d777-435a-90d4-9e449faaec76. {{(pid=80302) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.113s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211957062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cedaa39-13db-47b1-9885-201be8d77a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce52ef850324caf9d088e0f6462c7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:34Z,use_quota=True,user_id='9b8bd0d0918b4ee0861a63f4d46f5af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Creating volume 0cedaa39-13db-47b1-9885-201be8d77a8c {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bbb3a06c-ef2f-497c-8a71-03afe2bc819a tempest-VolumesActionsTest-1265505454 None] Copy volume to image completed successfully.
Sep 30 15:43:44 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=71, name=volume-0cedaa39-13db-47b1-9885-201be8d77a8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c 1073741824" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] <== create_volume: return (128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.130s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.299s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1421213844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62afe726-8538-4c30-a92c-d5eff2c96d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1880410fa84047d28f97024e47686250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:36Z,use_quota=True,user_id='40c5605449774feab701448797af9b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Creating volume 62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cb4ee7-f165-4e41-81a6-b68e17c38e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cedaa39-13db-47b1-9885-201be8d77a8c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb9a20d-95db-460e-bed1-54aa66968234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Volume volume-0cedaa39-13db-47b1-9885-201be8d77a8c (0cedaa39-13db-47b1-9885-201be8d77a8c): created successfully
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb9a20d-95db-460e-bed1-54aa66968234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:44 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=72, name=volume-62afe726-8538-4c30-a92c-d5eff2c96d00, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Flow 'volume_create_manager' (a8cc4ee1-4cb3-49f5-b4f7-f42f87253dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3339e12a-7fe6-40ad-9a63-5a70b74fb39a tempest-AttachVolumeTestJSON-972140354 None] Created volume successfully.
Sep 30 15:43:44 devstack quobyte-client[80089]: System call "getattr" of process 92052 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 1073741824" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] <== create_volume: return (155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.159s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e701ee77-6cef-4bb8-a79d-c7949d121a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62afe726-8538-4c30-a92c-d5eff2c96d00', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce985de-e87f-44a8-abae-838779b5dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Volume volume-62afe726-8538-4c30-a92c-d5eff2c96d00 (62afe726-8538-4c30-a92c-d5eff2c96d00): created successfully
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce985de-e87f-44a8-abae-838779b5dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Flow 'volume_create_manager' (7d785bbe-6d18-4afe-a365-b40781e7e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0c495681-4106-4732-91f3-63646e0fd943 tempest-SnapshotMetadataTestJSON-752914493 None] Created volume successfully.
Sep 30 15:43:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:45 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Creating offline snapshot e37781e8-71fd-435a-a807-12f3abc4f3d1 of volume 62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9f6a21-f51f-45b9-8534-a778b30e59f8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:45 devstack quobyte-client[80089]: System call "getattr" of process 92056 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:45 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=73, name=volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:45 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 1G" returned: 0 in 0.113s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): qemu-img rebase -u -b volume-62afe726-8538-4c30-a92c-d5eff2c96d00 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "qemu-img rebase -u -b volume-62afe726-8538-4c30-a92c-d5eff2c96d00 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:43:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.info" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.info" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.399s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.131s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[52349e5b-ea68-4466-a639-06033790f39d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:46 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-58e8f2c6-c893-4549-bf4c-91f704b9cf4a tempest-SnapshotMetadataTestJSON-752914493 None] Create snapshot completed successfully
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a34ede-1d7d-46d5-a10a-7fa79f9bf918]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.126s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:46 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img" returned: 0 in 1.520s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:47 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b58d1-43ea-476d-909c-bd6ab8e73387]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.272s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Image conversion details: src /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0, size 1024.00 MB, duration 1.52 sec, destination /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:43:48 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Converted 1024.00 MB image at 673.28 MB/s
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] 1c2fc275-6bfb-49fd-a443-c181866358c5 was raw, converting to qcow2 {{(pid=80302) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cbba03-740b-4fb0-8211-32150d52b349]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "cinder-e37781e8-71fd-435a-a807-12f3abc4f3d1-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-e37781e8-71fd-435a-a807-12f3abc4f3d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:48 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "cinder-quobyte-62afe726-8538-4c30-a92c-d5eff2c96d00" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-quobyte-62afe726-8538-4c30-a92c-d5eff2c96d00" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "cinder-quobyte-e37781e8-71fd-435a-a807-12f3abc4f3d1" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-quobyte-e37781e8-71fd-435a-a807-12f3abc4f3d1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Deleting offline snapshot e37781e8-71fd-435a-a807-12f3abc4f3d1 of volume 62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] snapshot_file for this snap is: volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a83cc1-9bab-4ebc-bd4b-f6c23c4bb24b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img" returned: 0 in 0.154s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62afe726-8538-4c30-a92c-d5eff2c96d00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd1e17d-709c-4b6c-bab7-9edcc1c25552]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img" returned: 1 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img /opt/stack/data/cinder/conversion/vol_upload_f9488unj {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img /opt/stack/data/cinder/conversion/vol_upload_f9488unj" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Image conversion details: src /opt/stack/data/cinder/conversion/cb4c0c67-bad9-49f7-ad16-51a3f504c8d0.temp_image.1c2fc275-6bfb-49fd-a443-c181866358c51uxmx0f6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f9488unj {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:43:48 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec7891-1156-4232-9622-d99246c58016]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9488unj {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9488unj" returned: 0 in 0.118s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1" returned: 0 in 0.091s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00.e37781e8-71fd-435a-a807-12f3abc4f3d1" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-quobyte-e37781e8-71fd-435a-a807-12f3abc4f3d1" released by "_delete_snapshot" :: held 0.466s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-quobyte-62afe726-8538-4c30-a92c-d5eff2c96d00" released by "delete_snapshot" :: held 0.478s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Created reservations ['11d6bcb2-64a1-4997-85dd-05321488aab7', '141637fb-6abe-4433-81b8-c669e7da3a08', '3b781262-412d-4d88-bd73-e98df931fe64', 'e13dc372-b22f-466a-9869-fc91f5a7485e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:48 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Delete snapshot completed successfully.
Sep 30 15:43:48 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d9391e36-a92e-487c-a37e-5461e386462b tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-e37781e8-71fd-435a-a807-12f3abc4f3d1-delete_snapshot" released by "delete_snapshot" :: held 0.563s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "cinder-62afe726-8538-4c30-a92c-d5eff2c96d00-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-62afe726-8538-4c30-a92c-d5eff2c96d00-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "cinder-quobyte-62afe726-8538-4c30-a92c-d5eff2c96d00" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-quobyte-62afe726-8538-4c30-a92c-d5eff2c96d00" acquired by "delete_volume" :: waited 0.014s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab9021-c219-40b4-a123-38ea58dce42c]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 3.416s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Uploaded volume to glance image-id: 1c2fc275-6bfb-49fd-a443-c181866358c5. {{(pid=80302) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53631f5-d78e-4b42-933b-df46dd4b2f45]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:49 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d907cbf4-c712-4dab-995f-5d2cfabc70e6 tempest-VolumesActionsTest-1265505454 None] Copy volume to image completed successfully.
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-62afe726-8538-4c30-a92c-d5eff2c96d00" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-quobyte-62afe726-8538-4c30-a92c-d5eff2c96d00" released by "delete_volume" :: held 0.205s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c" returned: 0 in 0.158s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.173s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-0cedaa39-13db-47b1-9885-201be8d77a8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46f7b2a2-9fdd-42ed-815b-8751619a8685', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:43:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Created reservations ['516b027c-5db4-4420-bfc9-21868bb045ad', '55a38491-19c1-48bf-aec8-c3c51ec01686', '2a5df0cd-10b8-4b82-aeeb-268df2c1f311', 'e7c829d3-d21c-4940-98b7-1ffca8f9945c'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:49 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-f847e85c-f5a0-4489-b668-074f9b664a84 req-5cc499c5-e1ee-473b-a9fb-5d8fb0c5ee67 tempest-AttachVolumeTestJSON-972140354 None] attachment_update completed successfully.
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:43:49 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Deleted volume successfully.
Sep 30 15:43:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-544becb9-f3aa-4966-ae31-94c9e41fe1e7 tempest-SnapshotMetadataTestJSON-752914493 None] Lock "cinder-62afe726-8538-4c30-a92c-d5eff2c96d00-delete_volume" released by "delete_volume" :: held 0.396s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Acquiring lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:50 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Acquiring lock "cinder-quobyte-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Lock "cinder-quobyte-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5292de-92ba-45f6-a4c2-2e46d04f144e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.170s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Lock "cinder-quobyte-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0" released by "delete_volume" :: held 0.215s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Created reservations ['87eb15ac-ded6-4b84-b9ba-daedb2cb8446', 'bd379117-f2e6-4e7b-b8d6-d19ed01135d0', '673147d9-0d8a-4e5f-9d01-6a8ac9d5866a', 'e60c9657-05fa-4324-beb6-c7a22e8241e5'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:43:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Deleted volume successfully.
Sep 30 15:43:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2f5f8f40-e358-4f44-b1f6-84d070168eca tempest-VolumesActionsTest-1265505454 None] Lock "cinder-cb4c0c67-bad9-49f7-ad16-51a3f504c8d0-delete_volume" released by "delete_volume" :: held 0.383s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=116,cinder:SELECT=112,cinder:DELETE=9,cinder:INSERT=27 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=102,cinder:UPDATE=107,cinder:INSERT=26,cinder:DELETE=9 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:43:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:43:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Flow 'volume_create_manager' (93768082-770c-4fd0-a3c2-53666fffcec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09696dd2-8dac-4cf2-a847-58c62dd9fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09696dd2-8dac-4cf2-a847-58c62dd9fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1866157251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23012054-8fcd-40c4-9908-8ecff8b1ef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abd23b138d647b1aea752a89f339ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:52Z,use_quota=True,user_id='016b54bbbe284e1d86ed4b9e720cbfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f25758-a4f0-4a39-b700-87a96a0acf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f25758-a4f0-4a39-b700-87a96a0acf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bea0c1-e9d0-4d34-aa3f-b2a0048994d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bea0c1-e9d0-4d34-aa3f-b2a0048994d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23012054-8fcd-40c4-9908-8ecff8b1ef59', 'volume_name': 'volume-23012054-8fcd-40c4-9908-8ecff8b1ef59', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8b8396-e8a7-414a-bf3c-07754f7e3df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8b8396-e8a7-414a-bf3c-07754f7e3df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf2a566-f269-4b32-bd64-a297442b70d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:52 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Volume 23012054-8fcd-40c4-9908-8ecff8b1ef59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23012054-8fcd-40c4-9908-8ecff8b1ef59', 'volume_size': 1}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1866157251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23012054-8fcd-40c4-9908-8ecff8b1ef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abd23b138d647b1aea752a89f339ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:43:52Z,use_quota=True,user_id='016b54bbbe284e1d86ed4b9e720cbfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Creating volume 23012054-8fcd-40c4-9908-8ecff8b1ef59 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:43:52 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:52 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=75, name=volume-23012054-8fcd-40c4-9908-8ecff8b1ef59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59 1073741824" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59" returned: 0 in 0.041s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] <== create_volume: return (201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.203s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf2a566-f269-4b32-bd64-a297442b70d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23012054-8fcd-40c4-9908-8ecff8b1ef59', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29830135-d18d-4b1c-a3a7-1d4b82e384e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:43:52 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Volume volume-23012054-8fcd-40c4-9908-8ecff8b1ef59 (23012054-8fcd-40c4-9908-8ecff8b1ef59): created successfully
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29830135-d18d-4b1c-a3a7-1d4b82e384e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:43:52 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Flow 'volume_create_manager' (93768082-770c-4fd0-a3c2-53666fffcec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:43:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-930f09f4-6c44-40a7-a34d-e984fc51893d tempest-VolumesNegativeTest-1442086173 None] Created volume successfully.
Sep 30 15:43:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:02 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:44:02 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:44:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-04ac67d0-01f1-4ac1-84b9-ffe6ec312207 req-f1e49ee9-123a-4b89-9ea3-9bb8ad565f3d tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-04ac67d0-01f1-4ac1-84b9-ffe6ec312207 req-f1e49ee9-123a-4b89-9ea3-9bb8ad565f3d tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-04ac67d0-01f1-4ac1-84b9-ffe6ec312207 req-f1e49ee9-123a-4b89-9ea3-9bb8ad565f3d tempest-AttachVolumeTestJSON-972140354 None] Terminate volume connection completed successfully.
Sep 30 15:44:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-04ac67d0-01f1-4ac1-84b9-ffe6ec312207 req-f1e49ee9-123a-4b89-9ea3-9bb8ad565f3d tempest-AttachVolumeTestJSON-972140354 None] Deleting attachment ea1ba6e8-1b39-4aa3-a984-db724889fafa. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:44:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Acquiring lock "cinder-23012054-8fcd-40c4-9908-8ecff8b1ef59-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Lock "cinder-23012054-8fcd-40c4-9908-8ecff8b1ef59-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Acquiring lock "cinder-quobyte-23012054-8fcd-40c4-9908-8ecff8b1ef59" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Lock "cinder-quobyte-23012054-8fcd-40c4-9908-8ecff8b1ef59" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2610c893-d8b6-4f49-bd0a-2b7a821c7652]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59" returned: 0 in 0.151s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-23012054-8fcd-40c4-9908-8ecff8b1ef59" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Lock "cinder-quobyte-23012054-8fcd-40c4-9908-8ecff8b1ef59" released by "delete_volume" :: held 0.238s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Created reservations ['4d9ae02d-50b4-461d-8fa3-a7cc0e65900a', '6595db81-3e58-41f5-89ac-e01cfe130fee', '3156b718-dde9-4abf-b108-60f72a6e9467', 'd3620dd2-b1db-4399-a3b0-88f71e606952'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Deleted volume successfully.
Sep 30 15:44:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f37dfd34-0e21-40e9-b496-aa48d087181e tempest-VolumesNegativeTest-1442086173 None] Lock "cinder-23012054-8fcd-40c4-9908-8ecff8b1ef59-delete_volume" released by "delete_volume" :: held 0.396s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:25 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Flow 'volume_create_manager' (5f06b46d-46e8-4900-a84d-b93c0ac9ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7487d3f5-2242-4b34-890c-a57d22f796d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7487d3f5-2242-4b34-890c-a57d22f796d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1133044283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace8299e-bc16-4867-80e6-10fee367ac67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2567fc0d03f140caa45259ad83c5b12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:25Z,use_quota=True,user_id='43bda092edf94c29a511bfb602fbb122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385646bb-c61e-4f28-bba8-40c57967416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385646bb-c61e-4f28-bba8-40c57967416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d67b8f-9a7e-47c7-a173-4377aaea0085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d67b8f-9a7e-47c7-a173-4377aaea0085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace8299e-bc16-4867-80e6-10fee367ac67', 'volume_name': 'volume-ace8299e-bc16-4867-80e6-10fee367ac67', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae56d4bb-42fa-4edb-8880-7e6d6fab2092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae56d4bb-42fa-4edb-8880-7e6d6fab2092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d276d-9789-488e-9639-a485347ba22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:25 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume ace8299e-bc16-4867-80e6-10fee367ac67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace8299e-bc16-4867-80e6-10fee367ac67', 'volume_size': 1}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1133044283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace8299e-bc16-4867-80e6-10fee367ac67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2567fc0d03f140caa45259ad83c5b12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:25Z,use_quota=True,user_id='43bda092edf94c29a511bfb602fbb122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Creating volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:44:25 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:25 devstack quobyte-client[80089]: System call "lookup" of process 92485 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:25 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=76, name=volume-ace8299e-bc16-4867-80e6-10fee367ac67, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 1073741824" returned: 0 in 0.174s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] <== create_volume: return (198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.201s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d276d-9789-488e-9639-a485347ba22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace8299e-bc16-4867-80e6-10fee367ac67', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6ca2b4-bf0f-49c5-96ce-825a30b09a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:25 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume volume-ace8299e-bc16-4867-80e6-10fee367ac67 (ace8299e-bc16-4867-80e6-10fee367ac67): created successfully
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6ca2b4-bf0f-49c5-96ce-825a30b09a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Flow 'volume_create_manager' (5f06b46d-46e8-4900-a84d-b93c0ac9ac68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:25 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d90bc816-3bc5-49aa-89bc-86148ee327a8 tempest-VolumesSnapshotListTestJSON-462075927 None] Created volume successfully.
Sep 30 15:44:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Creating offline snapshot b2967bda-c0e9-4afb-b44e-367ee22d1200 of volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9829ccbc-ae4f-41c0-a199-c2b3f804c7e5]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67" returned: 0 in 0.162s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=77, name=volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 1G" returned: 0 in 0.135s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ace8299e-bc16-4867-80e6-10fee367ac67 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img rebase -u -b volume-ace8299e-bc16-4867-80e6-10fee367ac67 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.info" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.info" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.486s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5254d8fc-3648-4c3a-aca9-8784d92e0338 tempest-VolumesSnapshotListTestJSON-462075927 None] Create snapshot completed successfully
Sep 30 15:44:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Flow 'volume_create_manager' (96b683b7-8525-4e1d-93a0-34732c685564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e15cebc-e6bd-4a79-ba6e-4dd917290a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e15cebc-e6bd-4a79-ba6e-4dd917290a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-364543628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677a19a0-aaa1-4461-8edd-482d603a28c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ca4012905146f5a2b8893a245a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:27Z,use_quota=True,user_id='3805b9929acb49ba86fd413525a8a248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d947f5-5ea6-45b4-859a-f0b2644e6ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d947f5-5ea6-45b4-859a-f0b2644e6ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b54fdc5-d661-40ce-b84f-5bca5d6af984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b54fdc5-d661-40ce-b84f-5bca5d6af984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677a19a0-aaa1-4461-8edd-482d603a28c1', 'volume_name': 'volume-677a19a0-aaa1-4461-8edd-482d603a28c1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcaf3bc8-d721-4f2e-b231-a4dd1254b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcaf3bc8-d721-4f2e-b231-a4dd1254b088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fdba2c-1fd6-4586-aafe-4c65dd96c729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Volume 677a19a0-aaa1-4461-8edd-482d603a28c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677a19a0-aaa1-4461-8edd-482d603a28c1', 'volume_size': 1}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-364543628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677a19a0-aaa1-4461-8edd-482d603a28c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ca4012905146f5a2b8893a245a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:27Z,use_quota=True,user_id='3805b9929acb49ba86fd413525a8a248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Creating volume 677a19a0-aaa1-4461-8edd-482d603a28c1 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:44:27 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=79, name=volume-677a19a0-aaa1-4461-8edd-482d603a28c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1 1073741824" returned: 0 in 0.117s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] <== create_volume: return (141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.143s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fdba2c-1fd6-4586-aafe-4c65dd96c729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677a19a0-aaa1-4461-8edd-482d603a28c1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b832af3d-6ee4-4b6c-8818-a4dd4c1df67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:27 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Volume volume-677a19a0-aaa1-4461-8edd-482d603a28c1 (677a19a0-aaa1-4461-8edd-482d603a28c1): created successfully
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b832af3d-6ee4-4b6c-8818-a4dd4c1df67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Flow 'volume_create_manager' (96b683b7-8525-4e1d-93a0-34732c685564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-766aac1e-fcab-4e1a-ba37-2e3210adc888 tempest-TestMinimumBasicScenario-12524641 None] Created volume successfully.
Sep 30 15:44:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Creating offline snapshot ada35cff-b040-4d6a-921f-44faaaa0f9bc of volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03cc2a0-94de-4fb9-bfb8-437a3ef460e4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack quobyte-client[80089]: System call "getattr" of process 92509 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:27 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=80, name=volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc 1G" returned: 0 in 0.100s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img rebase -u -b volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.359s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-adee69df-b477-4271-bdc1-327f69de4ce0 tempest-VolumesSnapshotListTestJSON-462075927 None] Create snapshot completed successfully
Sep 30 15:44:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Creating offline snapshot 78d839ff-bb12-4c93-b467-1990ffe61a12 of volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc79c7a-e8c7-44d3-8062-b0c26a5482cc]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:28 devstack quobyte-client[80089]: System call "getattr" of process 92520 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:28 devstack quobyte-client[80089]: System call "open" of process 92520 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=81, name=volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 1G" returned: 0 in 0.125s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:29 devstack quobyte-client[80089]: System call "getattr" of process 92524 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img rebase -u -b volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12" returned: 0 in 0.059s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.428s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f1fa70a4-8015-461c-908b-9d5199cc7451 tempest-VolumesSnapshotListTestJSON-462075927 None] Create snapshot completed successfully
Sep 30 15:44:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-78d839ff-bb12-4c93-b467-1990ffe61a12-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-78d839ff-bb12-4c93-b467-1990ffe61a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:30 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-78d839ff-bb12-4c93-b467-1990ffe61a12" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-78d839ff-bb12-4c93-b467-1990ffe61a12" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Deleting offline snapshot 78d839ff-bb12-4c93-b467-1990ffe61a12 of volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] snapshot_file for this snap is: volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f86122-c329-4405-b104-8772bdd7db6b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f47777d-847b-4f58-b52b-f8b939211156]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.137s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.78d839ff-bb12-4c93-b467-1990ffe61a12" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-78d839ff-bb12-4c93-b467-1990ffe61a12" released by "_delete_snapshot" :: held 0.506s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" released by "delete_snapshot" :: held 0.521s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fbf6b8-5b39-474d-a077-0e83d0533c6d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Created reservations ['87f959c2-f280-4155-a433-ac1c01d3b1a5', 'a95b4d95-f523-4906-a76c-0d230557578a', '5c2ee79f-eea8-4e18-a39f-607004f621ca', '0db93ad1-3547-4444-a747-e66104e88858'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Delete snapshot completed successfully.
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fab1bf33-b13a-4007-85e9-ce1f88f5877e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-78d839ff-bb12-4c93-b467-1990ffe61a12-delete_snapshot" released by "delete_snapshot" :: held 0.649s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.170s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-677a19a0-aaa1-4461-8edd-482d603a28c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1398dfb9-63d6-483f-8694-2c3ea678f209', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:44:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-4a8e8478-8779-4b08-bb49-612785dcbf99 req-fab964a2-bacf-47e5-84a9-28d71c25335e tempest-TestMinimumBasicScenario-12524641 None] attachment_update completed successfully.
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-ada35cff-b040-4d6a-921f-44faaaa0f9bc-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-ada35cff-b040-4d6a-921f-44faaaa0f9bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" acquired by "delete_snapshot" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-ada35cff-b040-4d6a-921f-44faaaa0f9bc" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ada35cff-b040-4d6a-921f-44faaaa0f9bc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Deleting offline snapshot ada35cff-b040-4d6a-921f-44faaaa0f9bc of volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] snapshot_file for this snap is: volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de4294-2f60-46ee-96f7-bd7c29e0612e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.137s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef22a0-0889-48a5-8ef6-4e5604b89d3b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.084s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.ada35cff-b040-4d6a-921f-44faaaa0f9bc" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ada35cff-b040-4d6a-921f-44faaaa0f9bc" released by "_delete_snapshot" :: held 0.429s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" released by "delete_snapshot" :: held 0.446s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Created reservations ['f9eba7d8-d8ad-4ee6-8167-0cafd048b830', '99ba8599-8d60-4b84-a5db-fda63d083931', '441a3689-880a-4de3-974e-46de668babdc', 'cb55b7bf-a63e-4b31-92ea-db6e947a23a3'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:32 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Delete snapshot completed successfully.
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-20f279a4-aed8-4520-b651-ff73fe5be3d9 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-ada35cff-b040-4d6a-921f-44faaaa0f9bc-delete_snapshot" released by "delete_snapshot" :: held 0.554s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-b2967bda-c0e9-4afb-b44e-367ee22d1200-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-b2967bda-c0e9-4afb-b44e-367ee22d1200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-b2967bda-c0e9-4afb-b44e-367ee22d1200" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-b2967bda-c0e9-4afb-b44e-367ee22d1200" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Deleting offline snapshot b2967bda-c0e9-4afb-b44e-367ee22d1200 of volume ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] snapshot_file for this snap is: volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a880bbc5-c31f-4aed-94fc-4589f80126a7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace8299e-bc16-4867-80e6-10fee367ac67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9183c79d-59dd-4cd2-9069-00e54b7c6aad]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:33 devstack quobyte-client[80089]: System call "open" of process 92573 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.084s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67.b2967bda-c0e9-4afb-b44e-367ee22d1200" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-b2967bda-c0e9-4afb-b44e-367ee22d1200" released by "_delete_snapshot" :: held 0.425s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" released by "delete_snapshot" :: held 0.436s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Created reservations ['cf5a9baa-efe0-4111-b7ce-73ba64e41778', 'c3c261f9-7429-46c2-99c1-d767a7f8a8f6', '977762b7-c9de-4c2b-8999-9b347f9a9c93', '78a3ec09-3bc2-47d9-bdff-e706b0245781'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Delete snapshot completed successfully.
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-039ca5c9-9190-47ed-91e5-a55ab8e3983e tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-b2967bda-c0e9-4afb-b44e-367ee22d1200-delete_snapshot" released by "delete_snapshot" :: held 0.514s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-ace8299e-bc16-4867-80e6-10fee367ac67-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-ace8299e-bc16-4867-80e6-10fee367ac67-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:33 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5af38-95db-413e-adfd-904340e49094]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ace8299e-bc16-4867-80e6-10fee367ac67" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-quobyte-ace8299e-bc16-4867-80e6-10fee367ac67" released by "delete_volume" :: held 0.196s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Created reservations ['c0caa174-a515-4b6a-a8ff-7c68bbb84f36', 'cf7ac96d-7640-47e3-af44-0337ca2c6f75', 'ab7704e0-31cf-4e09-a43b-2b88b9e5c9d7', 'b27f3314-8033-4a16-87aa-7892dcf621e9'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Deleted volume successfully.
Sep 30 15:44:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1c82f319-6362-45cd-b4cc-49c458d39742 tempest-VolumesSnapshotListTestJSON-462075927 None] Lock "cinder-ace8299e-bc16-4867-80e6-10fee367ac67-delete_volume" released by "delete_volume" :: held 0.336s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Flow 'volume_create_manager' (8eed7764-51b2-4d57-85c3-5bc7da3c26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966ad817-d678-4c50-916b-df5966685a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966ad817-d678-4c50-916b-df5966685a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-55134651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b02830-7dea-4d98-a0c9-6d78f64878f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee64b64e0574149829afd31214b6898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:37Z,use_quota=True,user_id='788300e9e3e040be9d2b8a086d8b1f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5992dfa-6dd9-4cf2-94c6-015498f41382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5992dfa-6dd9-4cf2-94c6-015498f41382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4cb91f-1684-4922-a2a5-ac4b43126c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4cb91f-1684-4922-a2a5-ac4b43126c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b02830-7dea-4d98-a0c9-6d78f64878f4', 'volume_name': 'volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4', 'volume_size': 2}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb7064-30e5-47db-9777-7d701bfd43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb7064-30e5-47db-9777-7d701bfd43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34406ea-9f2e-4129-a470-5a8b860363f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:37 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume c7b02830-7dea-4d98-a0c9-6d78f64878f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4', 'volume_size': 2}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-55134651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b02830-7dea-4d98-a0c9-6d78f64878f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee64b64e0574149829afd31214b6898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:37Z,use_quota=True,user_id='788300e9e3e040be9d2b8a086d8b1f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Creating volume c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:44:37 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 2147483648 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:37 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=82, name=volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 2147483648" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] <== create_volume: return (176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.179s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34406ea-9f2e-4129-a470-5a8b860363f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4', 'volume_size': 2}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff5d158-116d-4722-a2d3-95f463664a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:37 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 (c7b02830-7dea-4d98-a0c9-6d78f64878f4): created successfully
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff5d158-116d-4722-a2d3-95f463664a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Flow 'volume_create_manager' (8eed7764-51b2-4d57-85c3-5bc7da3c26dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-eefef548-4b7a-46e2-b5f8-466e94b8e721 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Created volume successfully.
Sep 30 15:44:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Creating offline snapshot 641c17ed-068b-44b3-bf3e-69e24e233436 of volume c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da8195d-b97a-4a1e-82f5-c2c206b5257a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack quobyte-client[80089]: System call "getattr" of process 92588 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4" returned: 0 in 0.183s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 2G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=83, name=volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 2G" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack quobyte-client[80089]: System call "open" of process 92594 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "qemu-img rebase -u -b volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436" returned: 0 in 0.074s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.info" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.info" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.591s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1ffa31ff-1e7f-43f2-bfd7-8ae3b111b5c6 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Create snapshot completed successfully
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "cinder-641c17ed-068b-44b3-bf3e-69e24e233436-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-641c17ed-068b-44b3-bf3e-69e24e233436-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:39 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "cinder-quobyte-c7b02830-7dea-4d98-a0c9-6d78f64878f4" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-quobyte-c7b02830-7dea-4d98-a0c9-6d78f64878f4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "cinder-quobyte-641c17ed-068b-44b3-bf3e-69e24e233436" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-quobyte-641c17ed-068b-44b3-bf3e-69e24e233436" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Deleting offline snapshot 641c17ed-068b-44b3-bf3e-69e24e233436 of volume c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] snapshot_file for this snap is: volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[907cebdb-e372-453b-94b4-a6d6adbaf553]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:39 devstack quobyte-client[80089]: System call "getattr" of process 92601 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436" returned: 0 in 0.179s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b5eed-ea3c-4b8e-a96f-222e173d5344]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:39 devstack quobyte-client[80089]: System call "open" of process 92605 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4" returned: 0 in 0.168s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:39 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-30dd779b-54b5-41e5-a143-e2f4dd88725a req-16e07dc2-fec2-40c5-a152-484ff8730239 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:39 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-30dd779b-54b5-41e5-a143-e2f4dd88725a req-16e07dc2-fec2-40c5-a152-484ff8730239 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:39 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-30dd779b-54b5-41e5-a143-e2f4dd88725a req-16e07dc2-fec2-40c5-a152-484ff8730239 tempest-AttachVolumeTestJSON-972140354 None] Terminate volume connection completed successfully.
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-30dd779b-54b5-41e5-a143-e2f4dd88725a req-16e07dc2-fec2-40c5-a152-484ff8730239 tempest-AttachVolumeTestJSON-972140354 None] Deleting attachment 46f7b2a2-9fdd-42ed-815b-8751619a8685. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4.641c17ed-068b-44b3-bf3e-69e24e233436" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-quobyte-641c17ed-068b-44b3-bf3e-69e24e233436" released by "_delete_snapshot" :: held 0.572s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-quobyte-c7b02830-7dea-4d98-a0c9-6d78f64878f4" released by "delete_snapshot" :: held 0.587s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Created reservations ['0b751dfb-ff95-4995-89de-7a5329432bf7', '291c92dd-375c-4bc5-ac91-583170ea4c28', '6fd381a9-239e-4454-9792-ba37643370e8', '44ef8dae-3507-42e9-a16d-8d3785435871'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Delete snapshot completed successfully.
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fa99b17a-37d3-4d18-a665-821ba8c29627 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-641c17ed-068b-44b3-bf3e-69e24e233436-delete_snapshot" released by "delete_snapshot" :: held 0.668s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "cinder-c7b02830-7dea-4d98-a0c9-6d78f64878f4-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-c7b02830-7dea-4d98-a0c9-6d78f64878f4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "cinder-quobyte-c7b02830-7dea-4d98-a0c9-6d78f64878f4" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-quobyte-c7b02830-7dea-4d98-a0c9-6d78f64878f4" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a5c7a-903b-4bfb-9f68-4064e06c2288]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4" returned: 0 in 0.157s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c7b02830-7dea-4d98-a0c9-6d78f64878f4" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-quobyte-c7b02830-7dea-4d98-a0c9-6d78f64878f4" released by "delete_volume" :: held 0.246s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Created reservations ['cf48e70d-5d83-4f86-982a-cc245d4a6079', 'bcc866cc-77c2-48ca-8005-68a9899f8bab', '416605fb-2b0d-4694-8de1-3012e2271f65', '1876b807-ef42-4f7a-97b3-75ef80a3611e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Deleted volume successfully.
Sep 30 15:44:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-fe94f131-84be-469b-9f85-7e641daa9d05 tempest-VolumesSnapshotNegativeTestJSON-304908596 None] Lock "cinder-c7b02830-7dea-4d98-a0c9-6d78f64878f4-delete_volume" released by "delete_volume" :: held 0.442s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "cinder-0cedaa39-13db-47b1-9885-201be8d77a8c-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-0cedaa39-13db-47b1-9885-201be8d77a8c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "cinder-quobyte-0cedaa39-13db-47b1-9885-201be8d77a8c" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-quobyte-0cedaa39-13db-47b1-9885-201be8d77a8c" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab213c2-d5ce-4ac8-b776-77f57b414e64]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c" returned: 0 in 0.190s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0cedaa39-13db-47b1-9885-201be8d77a8c" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-quobyte-0cedaa39-13db-47b1-9885-201be8d77a8c" released by "delete_volume" :: held 0.258s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Created reservations ['b98ae7ea-3ab3-41d1-a8a2-1bf95d151ce9', 'd979ac5e-c2c3-4c29-8b86-6e61826ec967', '7ecbce13-9406-44f7-a397-fe56890284a9', 'abea0ee3-7cbf-419d-aef1-da8116213648'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:49 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Deleted volume successfully.
Sep 30 15:44:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1216b0ad-55b1-4e2f-a924-cdd75bc8b6cb tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-0cedaa39-13db-47b1-9885-201be8d77a8c-delete_volume" released by "delete_volume" :: held 0.438s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "cinder-c3bff706-3ecb-4a86-90f2-5456dbbdc79b-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-c3bff706-3ecb-4a86-90f2-5456dbbdc79b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:50 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "cinder-quobyte-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-quobyte-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43e496-e372-4f7f-8b7b-e3cc22fa1601]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" returned: 0 in 0.206s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-quobyte-c3bff706-3ecb-4a86-90f2-5456dbbdc79b" released by "delete_volume" :: held 0.327s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Created reservations ['e5fad0d6-c9a2-4e30-9d0a-d3e3f3959fdf', 'afd1242d-3dad-4cbd-9e1d-073cf1886e9e', '71cdf765-3a99-4268-b2e4-06e236a4c8c7', '7ec0aeab-d204-44b0-950f-c69df4d09132'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Deleted volume successfully.
Sep 30 15:44:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bb6f882f-50ea-40bd-89eb-54ddca49c55a tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-c3bff706-3ecb-4a86-90f2-5456dbbdc79b-delete_volume" released by "delete_volume" :: held 0.529s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "cinder-9308c77a-7813-49f1-9c85-bf03ead8474b-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-9308c77a-7813-49f1-9c85-bf03ead8474b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:51 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "cinder-quobyte-9308c77a-7813-49f1-9c85-bf03ead8474b" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-quobyte-9308c77a-7813-49f1-9c85-bf03ead8474b" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bafaae-c11f-4316-a8da-75e455901f0a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b" returned: 0 in 0.206s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9308c77a-7813-49f1-9c85-bf03ead8474b" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-quobyte-9308c77a-7813-49f1-9c85-bf03ead8474b" released by "delete_volume" :: held 0.297s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Created reservations ['db12d04c-bf1d-416e-a2c6-e7c80440e02d', '802a5b0b-9320-4cce-83ba-8f399f2f3531', 'a4fc759f-df7f-40e0-88f9-335a2472b722', '38fe2f0f-fb46-4cc0-8f9e-3fef578a9718'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.042s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:52 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:44:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Deleted volume successfully.
Sep 30 15:44:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-78949c5e-78d5-40da-8172-097cd9c96fb8 tempest-AttachVolumeTestJSON-972140354 None] Lock "cinder-9308c77a-7813-49f1-9c85-bf03ead8474b-delete_volume" released by "delete_volume" :: held 0.513s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:44:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Flow 'volume_create_manager' (c73ae24b-4afc-4920-a846-fcd0079cfe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd641e1-7185-4979-a0c6-fb94076e8f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd641e1-7185-4979-a0c6-fb94076e8f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1204271900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7367f07f-d27d-4538-a179-d094484cb623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9601605d5c8e40ab8e755dfd1b660c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:59Z,use_quota=True,user_id='e0860e39ed1f49ae821f6f8fee15ba45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20fbcf67-dd50-4c34-9f08-790a6373e82f),volume_type_id=20fbcf67-dd50-4c34-9f08-790a6373e82f)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776953ce-fa1b-4910-a525-81d23ae0a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776953ce-fa1b-4910-a525-81d23ae0a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5765c1de-0204-4407-94de-5516066edd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5765c1de-0204-4407-94de-5516066edd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7367f07f-d27d-4538-a179-d094484cb623', 'volume_name': 'volume-7367f07f-d27d-4538-a179-d094484cb623', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc25a70-636f-411e-a329-e8c866f5b381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc25a70-636f-411e-a329-e8c866f5b381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ecca1d-7b48-4c71-bc00-c6d7cfc48df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume 7367f07f-d27d-4538-a179-d094484cb623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7367f07f-d27d-4538-a179-d094484cb623', 'volume_size': 1}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1204271900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7367f07f-d27d-4538-a179-d094484cb623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9601605d5c8e40ab8e755dfd1b660c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:59Z,use_quota=True,user_id='e0860e39ed1f49ae821f6f8fee15ba45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20fbcf67-dd50-4c34-9f08-790a6373e82f),volume_type_id=20fbcf67-dd50-4c34-9f08-790a6373e82f)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Creating volume 7367f07f-d27d-4538-a179-d094484cb623 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:59 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=85, name=volume-7367f07f-d27d-4538-a179-d094484cb623, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Flow 'volume_create_manager' (c8e815bd-093b-4faf-863c-c255b9a712c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f4b479-9b68-444a-8cda-c74b1dbb6f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f4b479-9b68-444a-8cda-c74b1dbb6f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1893651127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868dccd4-65d5-4852-be26-e9713c6c5e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9601605d5c8e40ab8e755dfd1b660c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:59Z,use_quota=True,user_id='e0860e39ed1f49ae821f6f8fee15ba45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30972978-a25f-4ab1-8606-c66a59f0e703),volume_type_id=30972978-a25f-4ab1-8606-c66a59f0e703)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06614f0e-1fb4-4d65-b3a9-c46326b21364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06614f0e-1fb4-4d65-b3a9-c46326b21364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105ca6f3-36d5-4749-b4e2-1df93f52c916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105ca6f3-36d5-4749-b4e2-1df93f52c916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868dccd4-65d5-4852-be26-e9713c6c5e91', 'volume_name': 'volume-868dccd4-65d5-4852-be26-e9713c6c5e91', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43916e8-db15-498e-8f59-013b2445d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43916e8-db15-498e-8f59-013b2445d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6480e8-a371-4bd7-8759-8d3293eba893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume 868dccd4-65d5-4852-be26-e9713c6c5e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868dccd4-65d5-4852-be26-e9713c6c5e91', 'volume_size': 1}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623 1073741824" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] <== create_volume: return (174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.181s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1893651127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868dccd4-65d5-4852-be26-e9713c6c5e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9601605d5c8e40ab8e755dfd1b660c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:44:59Z,use_quota=True,user_id='e0860e39ed1f49ae821f6f8fee15ba45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30972978-a25f-4ab1-8606-c66a59f0e703),volume_type_id=30972978-a25f-4ab1-8606-c66a59f0e703)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Creating volume 868dccd4-65d5-4852-be26-e9713c6c5e91 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ecca1d-7b48-4c71-bc00-c6d7cfc48df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7367f07f-d27d-4538-a179-d094484cb623', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755c742e-7a4a-4a7a-98fd-e29df4729073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=86, name=volume-868dccd4-65d5-4852-be26-e9713c6c5e91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume volume-7367f07f-d27d-4538-a179-d094484cb623 (7367f07f-d27d-4538-a179-d094484cb623): created successfully
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755c742e-7a4a-4a7a-98fd-e29df4729073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Flow 'volume_create_manager' (c73ae24b-4afc-4920-a846-fcd0079cfe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7f22a7cf-5ab7-4445-a945-7e3701f20146 tempest-TestInstancesWithCinderVolumes-1664779642 None] Created volume successfully.
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91 1073741824" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.185s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6480e8-a371-4bd7-8759-8d3293eba893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868dccd4-65d5-4852-be26-e9713c6c5e91', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0840c277-558e-4f7e-85c7-cd57edd23823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume volume-868dccd4-65d5-4852-be26-e9713c6c5e91 (868dccd4-65d5-4852-be26-e9713c6c5e91): created successfully
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0840c277-558e-4f7e-85c7-cd57edd23823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Flow 'volume_create_manager' (c8e815bd-093b-4faf-863c-c255b9a712c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Flow 'volume_create_manager' (905678b9-b317-4de8-9166-b4524312753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb51e3d-b946-47cf-a468-6c844bff3138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb51e3d-b946-47cf-a468-6c844bff3138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1126094839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b67d0f8-be7d-4611-ae26-f5a7c2a0c597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9601605d5c8e40ab8e755dfd1b660c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:00Z,use_quota=True,user_id='e0860e39ed1f49ae821f6f8fee15ba45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28426292-1a3e-4640-8f5a-5f0d5509d6a2),volume_type_id=28426292-1a3e-4640-8f5a-5f0d5509d6a2)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34f5341-2abc-47c3-b42e-9f562383b87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34f5341-2abc-47c3-b42e-9f562383b87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c9ccf5-14eb-4137-a2fd-a7a3b8dd6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5ed8b7af-f8f9-4d75-a479-5f490ae3db5b tempest-TestInstancesWithCinderVolumes-1664779642 None] Created volume successfully.
Sep 30 15:44:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c9ccf5-14eb-4137-a2fd-a7a3b8dd6a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b67d0f8-be7d-4611-ae26-f5a7c2a0c597', 'volume_name': 'volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597', 'volume_size': 1, 'image_id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--608380290', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9601605d5c8e40ab8e755dfd1b660c49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'created_at': datetime.datetime(2025, 9, 30, 13, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 44, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4195f61d0>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dd24d0-1a5d-4b36-9261-b6a04ab40887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dd24d0-1a5d-4b36-9261-b6a04ab40887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9597f5-0134-4de6-82f2-a9ed472b221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:44:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597', 'volume_size': 1, 'image_id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--608380290', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9601605d5c8e40ab8e755dfd1b660c49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'created_at': datetime.datetime(2025, 9, 30, 13, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 44, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4195f61d0>}
Sep 30 15:44:59 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Cloning 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 from image 6d4c24c2-16c7-41ed-8d91-4a798f31226b  at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:45:00 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:45:00 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 15:45:01 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e07787f-d3a1-4b1a-b481-f6442d334eaa]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:01 devstack sudo[92711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD
Sep 30 15:45:01 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:45:01 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root
Sep 30 15:45:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:01 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Temporary image 6d4c24c2-16c7-41ed-8d91-4a798f31226b is fetched for user e0860e39ed1f49ae821f6f8fee15ba45. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:45:01 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e722d-b660-4a87-8295-87aab454ebdc]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:01 devstack sudo[92716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD
Sep 30 15:45:01 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:45:02 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1126094839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b67d0f8-be7d-4611-ae26-f5a7c2a0c597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9601605d5c8e40ab8e755dfd1b660c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:00Z,use_quota=True,user_id='e0860e39ed1f49ae821f6f8fee15ba45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28426292-1a3e-4640-8f5a-5f0d5509d6a2),volume_type_id=28426292-1a3e-4640-8f5a-5f0d5509d6a2)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Creating volume 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:45:02 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:02 devstack quobyte-client[80089]: System call "open" of process 92722 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:02 devstack quobyte-client[80089]: System call "ioctl" of process 92722 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:02 devstack quobyte-client[80089]: System call "open" of process 92722 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:02 devstack quobyte-client[80089]: System call "ioctl" of process 92722 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:02 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=87, name=volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 1073741824" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] <== create_volume: return (162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.166s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Attempting download of 6d4c24c2-16c7-41ed-8d91-4a798f31226b ((None, [{'url': 'file:///opt/stack/data/glance/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'metadata': {}}])) to volume 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7866c48-3018-42b6-bd6f-4d6ffb8373d6]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:02 devstack sudo[92726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj
Sep 30 15:45:02 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:45:03 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj" returned: 0 in 0.569s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:03 devstack sudo[92730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj
Sep 30 15:45:03 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:45:03 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj" returned: 1 in 0.524s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d4c24c2-16c7-41ed-8d91-4a798f31226b_ucot_yuj' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73fdb5e-f856-4cdb-896f-39a14069ad13]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:03 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2b3ddef1-eeb9-4a16-a5ad-d49ee939a00b tempest-BackendsCapabilitiesAdminTestsJSON-257472497 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.15', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08403396606445, 'free_capacity_gb': 231.08403396606445, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80302) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 30 15:45:03 devstack sudo[92734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD
Sep 30 15:45:03 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:45:04 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] 6d4c24c2-16c7-41ed-8d91-4a798f31226b was qcow2, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:04 devstack sudo[92741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597
Sep 30 15:45:04 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2a0a6c6f-9d25-4c7b-b233-f2f2724dc7b8 tempest-BackendsCapabilitiesAdminTestsJSON-257472497 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.15', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08403396606445, 'free_capacity_gb': 231.08403396606445, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80302) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 30 15:45:04 devstack quobyte-client[80089]: System call "setlk" of process 92745 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:04 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" returned: 0 in 0.812s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d4c24c2-16c7-41ed-8d91-4a798f31226b_9ojta8xsdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:45:04 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16257b-2087-4a49-a40f-07e14d6195c0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" returned: 0 in 0.164s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 1G" returned: 0 in 0.057s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Downloaded image 6d4c24c2-16c7-41ed-8d91-4a798f31226b ((None, [{'url': 'file:///opt/stack/data/glance/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'metadata': {}}])) to volume 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Temporary image 6d4c24c2-16c7-41ed-8d91-4a798f31226b for user e0860e39ed1f49ae821f6f8fee15ba45 is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Marking volume 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Copying metadata from image 6d4c24c2-16c7-41ed-8d91-4a798f31226b to 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Creating volume glance metadata for volume 1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 backed by image 6d4c24c2-16c7-41ed-8d91-4a798f31226b with: {'image_id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'image_name': 'tempest-scenario-img--608380290', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9597f5-0134-4de6-82f2-a9ed472b221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597', 'volume_size': 1, 'image_id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--608380290', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9601605d5c8e40ab8e755dfd1b660c49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6d4c24c2-16c7-41ed-8d91-4a798f31226b', 'created_at': datetime.datetime(2025, 9, 30, 13, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 44, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d4c24c2-16c7-41ed-8d91-4a798f31226b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4195f61d0>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4183ba67-0fc2-4b3c-8c21-e8a454a1cecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:05 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 (1b67d0f8-be7d-4611-ae26-f5a7c2a0c597): created successfully
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4183ba67-0fc2-4b3c-8c21-e8a454a1cecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:05 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Flow 'volume_create_manager' (905678b9-b317-4de8-9166-b4524312753e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6aa692a1-271c-4d31-a803-9eae28d6b411 tempest-TestInstancesWithCinderVolumes-1664779642 None] Created volume successfully.
Sep 30 15:45:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-9ed63f20-7d4b-47bf-a56c-3f25463b9088 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9ed63f20-7d4b-47bf-a56c-3f25463b9088 tempest-GroupSnapshotsTest-130905406 None] Group tempest-GroupSnapshotsTest-Group-1560513727: creating
Sep 30 15:45:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9ed63f20-7d4b-47bf-a56c-3f25463b9088 tempest-GroupSnapshotsTest-130905406 None] Group tempest-GroupSnapshotsTest-Group-1560513727: created successfully
Sep 30 15:45:08 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9ed63f20-7d4b-47bf-a56c-3f25463b9088 tempest-GroupSnapshotsTest-130905406 None] Create group completed successfully.
Sep 30 15:45:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (b90610dc-23dd-4527-addf-5448b9961426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc89693-7d56-4966-9804-aa99adf13fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc89693-7d56-4966-9804-aa99adf13fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-156401437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e65dcde7-bc9a-43af-b761-db2f5adc798b,host='devstack@QuobyteHD#QuobyteHD',id=755b2b10-5d8a-428a-bdc8-d12cab83f12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:09Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b18ebb9-2d7e-48a5-a539-3b2a9025f0e5),volume_type_id=9b18ebb9-2d7e-48a5-a539-3b2a9025f0e5)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ff1281-3ac2-4ada-af1d-022450e89925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ff1281-3ac2-4ada-af1d-022450e89925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222f6443-c72c-4936-a533-6ffa870d77fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222f6443-c72c-4936-a533-6ffa870d77fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755b2b10-5d8a-428a-bdc8-d12cab83f12e', 'volume_name': 'volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803c3c8-9a67-40da-89e5-c9e338a616e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803c3c8-9a67-40da-89e5-c9e338a616e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b39c85-6981-4bd1-9257-838376ab452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:09 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Volume 755b2b10-5d8a-428a-bdc8-d12cab83f12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e', 'volume_size': 1}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e65dcde7-bc9a-43af-b761-db2f5adc798b,created_at=2025-09-30T13:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-156401437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e65dcde7-bc9a-43af-b761-db2f5adc798b,host='devstack@QuobyteHD#QuobyteHD',id=755b2b10-5d8a-428a-bdc8-d12cab83f12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:09Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b18ebb9-2d7e-48a5-a539-3b2a9025f0e5),volume_type_id=9b18ebb9-2d7e-48a5-a539-3b2a9025f0e5)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Creating volume 755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:45:09 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:09 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=88, name=volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e 1073741824" returned: 0 in 0.110s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] <== create_volume: return (135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.138s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b39c85-6981-4bd1-9257-838376ab452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e8494f-cd3c-4ac6-998f-34f6af3db566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:09 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Volume volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e (755b2b10-5d8a-428a-bdc8-d12cab83f12e): created successfully
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e8494f-cd3c-4ac6-998f-34f6af3db566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (b90610dc-23dd-4527-addf-5448b9961426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c020510b-50a3-4375-96fc-5f13256d9dd3 tempest-GroupSnapshotsTest-130905406 None] Created volume successfully.
Sep 30 15:45:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] GroupSnapshot 5ec6f513-8aba-44c4-aeb0-c7d65d49e17c: creating.
Sep 30 15:45:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Group snapshot 5ec6f513-8aba-44c4-aeb0-c7d65d49e17c: creating. {{(pid=80302) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Creating offline snapshot 3e3ba4c3-690a-48b4-a1e7-f8fd05507222 of volume 755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacfa5e6-ff02-4526-ab8d-5e662323f575]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.138s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:10 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=89, name=volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 1G" returned: 0 in 0.110s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img rebase -u -b volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.042s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:45:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.info" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.info" returned: 0 in 0.043s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.454s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:11 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a4fb5bc7-5ab0-4db0-8a21-2fa5460df43b tempest-GroupSnapshotsTest-130905406 None] group_snapshot 5ec6f513-8aba-44c4-aeb0-c7d65d49e17c: created successfully
Sep 30 15:45:12 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-3e3ba4c3-690a-48b4-a1e7-f8fd05507222-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" by "_create_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-3e3ba4c3-690a-48b4-a1e7-f8fd05507222-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Creating volume d3230ef6-ddf7-46e0-9e56-ab5bbf804341 from snapshot 3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:360}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" by "_copy_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] snapshot: 3e3ba4c3-690a-48b4-a1e7-f8fd05507222, volume: d3230ef6-ddf7-46e0-9e56-ab5bbf804341,  {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=77,cinder:UPDATE=89,cinder:INSERT=24,cinder:DELETE=9 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[09327084-14d0-4cdd-b534-c880e52d450d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:424}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Creating direct copy from snapshot {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:432}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[68536315-e538-43e2-b7a8-8d910f01cdef]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:13 devstack quobyte-client[80089]: System call "lookup" of process 92842 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:13 devstack quobyte-client[80089]: System call "getattr" of process 92842 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.170s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:13 devstack cinder-volume[80302]: DEBUG cinder.utils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 not found in is_blk_device check {{(pid=80302) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 15:45:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:13 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=91, name=volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" returned: 0 in 1.809s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf655ed-a3c5-4c6e-ab02-b974a7b68508]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:15 devstack quobyte-client[80089]: System call "getattr" of process 92855 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:15 devstack quobyte-client[80089]: System call "open" of process 92855 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.296s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Image conversion details: src /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:45:15 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Converted 1024.00 MB image at 565.54 MB/s
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" released by "_copy_volume_from_snapshot" :: held 2.521s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-3e3ba4c3-690a-48b4-a1e7-f8fd05507222-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" released by "_create_volume_from_snapshot" :: held 2.537s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.552s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.551s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=92,cinder:INSERT=25,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f24800-9503-425d-8eef-4b1810d38e6f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:15 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ace4be24-81ad-40f9-af2b-3e23abd495cd tempest-GroupSnapshotsTest-130905406 None] Create group from source-snapshot-5ec6f513-8aba-44c4-aeb0-c7d65d49e17c completed successfully.
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.194s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58884f4f-e364-4991-98cd-fbfce50a3de0', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:45:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:15 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-06665964-f5d2-4b23-a464-a215bc9b28a1 req-a492c7a6-c0a9-42bc-8e13-c61823f16ff2 tempest-TestInstancesWithCinderVolumes-1664779642 None] attachment_update completed successfully.
Sep 30 15:45:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[09419a75-78cd-4dcc-b616-15906de65cd7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-d3230ef6-ddf7-46e0-9e56-ab5bbf804341" released by "delete_volume" :: held 0.209s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['16c02fd8-ea05-419a-a6af-9349948196ab'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:16 devstack cinder-volume[80302]: WARNING cinder.quota [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1843202474 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1843202474, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:16 devstack cinder-volume[80302]: WARNING cinder.quota [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1843202474 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1843202474, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['10088fd0-b361-46f3-b80d-557eb4018dee', 'bfb55ecc-d949-41c0-bf32-5d6548107735', 'a93eecaf-a5b0-48bc-bfe2-a951cb8086e7', '6e996428-85a3-476f-b1a4-8c9e689b4165'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:16 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:45:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-29ef1c0e-8bf9-4c2a-b695-6ca98d58e588 tempest-GroupSnapshotsTest-130905406 None] Delete group completed successfully.
Sep 30 15:45:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] group_snapshot 5ec6f513-8aba-44c4-aeb0-c7d65d49e17c: deleting
Sep 30 15:45:17 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] group_snapshot 5ec6f513-8aba-44c4-aeb0-c7d65d49e17c: deleting {{(pid=80302) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-755b2b10-5d8a-428a-bdc8-d12cab83f12e" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-755b2b10-5d8a-428a-bdc8-d12cab83f12e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-3e3ba4c3-690a-48b4-a1e7-f8fd05507222" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-3e3ba4c3-690a-48b4-a1e7-f8fd05507222" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Deleting offline snapshot 3e3ba4c3-690a-48b4-a1e7-f8fd05507222 of volume 755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] snapshot_file for this snap is: volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e479a32-3d88-4bc1-8002-0276b6372c62]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:17 devstack quobyte-client[80089]: System call "getattr" of process 92870 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03737fa-4284-463f-8d76-f9082fd03688]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.167s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:18 devstack quobyte-client[80089]: System call "setlk" of process 92878 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.089s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e.3e3ba4c3-690a-48b4-a1e7-f8fd05507222" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-3e3ba4c3-690a-48b4-a1e7-f8fd05507222" released by "_delete_snapshot" :: held 0.499s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-755b2b10-5d8a-428a-bdc8-d12cab83f12e" released by "delete_snapshot" :: held 0.515s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:18 devstack cinder-volume[80302]: WARNING cinder.quota [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1843202474 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1843202474, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:18 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['ae203bf7-ddd0-41ba-a16c-a19670fd49e9', '9998e7b9-2083-4b19-992d-00578929f5a5', '0c145896-140e-419b-ba82-02d9d24ad0f6', '2c1e8df4-cf9a-4542-b872-8a00e09bf562'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-1037e8c9-d22a-4212-afd2-5427186ec354 tempest-GroupSnapshotsTest-130905406 None] group_snapshot 5ec6f513-8aba-44c4-aeb0-c7d65d49e17c: deleted successfully
Sep 30 15:45:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-755b2b10-5d8a-428a-bdc8-d12cab83f12e" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-755b2b10-5d8a-428a-bdc8-d12cab83f12e" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f3fed-b416-4ece-ab92-9fa8a7f06185]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-755b2b10-5d8a-428a-bdc8-d12cab83f12e" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-755b2b10-5d8a-428a-bdc8-d12cab83f12e" released by "delete_volume" :: held 0.216s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['320f4539-e395-447a-9a4d-63e1e6ee5c31'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:19 devstack cinder-volume[80302]: WARNING cinder.db.sqlalchemy.api [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1843202474']
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['7221bb0d-9145-477d-ab5a-1c3a4f9a4b3b', '4b6b3066-2daf-49aa-8a29-88cb11677495', '18d8b9d8-d455-4e21-be84-d02d2df66ea0', '658f4887-f3df-4dd7-910f-9da3f9c213c9'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:19 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:45:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-353e55d0-abe6-411b-bebb-13ed89f57b15 tempest-GroupSnapshotsTest-130905406 None] Delete group completed successfully.
Sep 30 15:45:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f4add397-8a04-4d89-9bf4-ff23551cc5c6 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f4add397-8a04-4d89-9bf4-ff23551cc5c6 tempest-GroupSnapshotsTest-130905406 None] Group tempest-GroupSnapshotsTest-Group-537323928: creating
Sep 30 15:45:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f4add397-8a04-4d89-9bf4-ff23551cc5c6 tempest-GroupSnapshotsTest-130905406 None] Group tempest-GroupSnapshotsTest-Group-537323928: created successfully
Sep 30 15:45:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f4add397-8a04-4d89-9bf4-ff23551cc5c6 tempest-GroupSnapshotsTest-130905406 None] Create group completed successfully.
Sep 30 15:45:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (2c84dcfb-5e16-43d2-8854-0fb6073bcd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eca7b88-19ba-43cf-ace2-20ae140eb58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eca7b88-19ba-43cf-ace2-20ae140eb58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1556303321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b543de7c-f6a0-4909-85a6-8023148b9387,host='devstack@QuobyteHD#QuobyteHD',id=5a7855b0-bda9-485f-84e7-e5628127836e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:22Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617c540c-e945-421b-bb8d-ebf5b5bbc279),volume_type_id=617c540c-e945-421b-bb8d-ebf5b5bbc279)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d2ab3b-a165-4d9d-8f9b-901a014f7fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d2ab3b-a165-4d9d-8f9b-901a014f7fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bff563-3a60-4645-86f3-b8e258bccc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bff563-3a60-4645-86f3-b8e258bccc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7855b0-bda9-485f-84e7-e5628127836e', 'volume_name': 'volume-5a7855b0-bda9-485f-84e7-e5628127836e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7550622-9227-4731-be32-91666949b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7550622-9227-4731-be32-91666949b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933bba2c-83ca-47eb-9eec-d4f23336abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:22 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Volume 5a7855b0-bda9-485f-84e7-e5628127836e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7855b0-bda9-485f-84e7-e5628127836e', 'volume_size': 1}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b543de7c-f6a0-4909-85a6-8023148b9387,created_at=2025-09-30T13:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1556303321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b543de7c-f6a0-4909-85a6-8023148b9387,host='devstack@QuobyteHD#QuobyteHD',id=5a7855b0-bda9-485f-84e7-e5628127836e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:22Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617c540c-e945-421b-bb8d-ebf5b5bbc279),volume_type_id=617c540c-e945-421b-bb8d-ebf5b5bbc279)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Creating volume 5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:45:22 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:22 devstack quobyte-client[80089]: System call "lookup" of process 92964 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:22 devstack quobyte-client[80089]: System call "create" of process 92964 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:22 devstack quobyte-client[80089]: System call "getattr" of process 92964 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:22 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=92, name=volume-5a7855b0-bda9-485f-84e7-e5628127836e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e 1073741824" returned: 0 in 0.230s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] <== create_volume: return (268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.270s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933bba2c-83ca-47eb-9eec-d4f23336abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7855b0-bda9-485f-84e7-e5628127836e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d14640-d7de-4e71-845f-db686b93b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:22 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Volume volume-5a7855b0-bda9-485f-84e7-e5628127836e (5a7855b0-bda9-485f-84e7-e5628127836e): created successfully
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d14640-d7de-4e71-845f-db686b93b765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:22 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (2c84dcfb-5e16-43d2-8854-0fb6073bcd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-82ad4abf-c4a9-4e5d-a15f-0dc36037f9d0 tempest-GroupSnapshotsTest-130905406 None] Created volume successfully.
Sep 30 15:45:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (84b10fa8-88da-45cd-bf98-ceae1e2a4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0cab8e-54d1-47fa-b42f-a66a5b8e881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0cab8e-54d1-47fa-b42f-a66a5b8e881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124467189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b543de7c-f6a0-4909-85a6-8023148b9387,host='devstack@QuobyteHD#QuobyteHD',id=ee993b62-52a5-4a6f-905b-280169bdec53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:23Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617c540c-e945-421b-bb8d-ebf5b5bbc279),volume_type_id=617c540c-e945-421b-bb8d-ebf5b5bbc279)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b08138-b5fa-4fd7-a256-aebd3605799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b08138-b5fa-4fd7-a256-aebd3605799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e353f05-d670-432f-b3f2-0cab30375fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e353f05-d670-432f-b3f2-0cab30375fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee993b62-52a5-4a6f-905b-280169bdec53', 'volume_name': 'volume-ee993b62-52a5-4a6f-905b-280169bdec53', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919ac993-d41a-4115-8563-e3cfaa21f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919ac993-d41a-4115-8563-e3cfaa21f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baed3589-0af8-4afb-bbb5-cd673b281fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:23 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Volume ee993b62-52a5-4a6f-905b-280169bdec53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee993b62-52a5-4a6f-905b-280169bdec53', 'volume_size': 1}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b543de7c-f6a0-4909-85a6-8023148b9387,created_at=2025-09-30T13:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124467189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b543de7c-f6a0-4909-85a6-8023148b9387,host='devstack@QuobyteHD#QuobyteHD',id=ee993b62-52a5-4a6f-905b-280169bdec53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:23Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617c540c-e945-421b-bb8d-ebf5b5bbc279),volume_type_id=617c540c-e945-421b-bb8d-ebf5b5bbc279)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Creating volume ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:45:23 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:23 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=93, name=volume-ee993b62-52a5-4a6f-905b-280169bdec53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 1073741824" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] <== create_volume: return (161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.163s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baed3589-0af8-4afb-bbb5-cd673b281fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee993b62-52a5-4a6f-905b-280169bdec53', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32b0308-65b4-4045-8ad1-3138351d02fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:23 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Volume volume-ee993b62-52a5-4a6f-905b-280169bdec53 (ee993b62-52a5-4a6f-905b-280169bdec53): created successfully
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32b0308-65b4-4045-8ad1-3138351d02fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:23 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (84b10fa8-88da-45cd-bf98-ceae1e2a4f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f5c71a5d-e1fd-4850-8dd0-38939c5fad17 tempest-GroupSnapshotsTest-130905406 None] Created volume successfully.
Sep 30 15:45:24 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-57476078-c325-47f4-9a27-a33c6c589196 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:24 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-57476078-c325-47f4-9a27-a33c6c589196 tempest-GroupSnapshotsTest-130905406 None] Update group completed successfully.
Sep 30 15:45:25 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-667d8d88-424f-496b-9f67-004dcdd37e86 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:25 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-667d8d88-424f-496b-9f67-004dcdd37e86 tempest-GroupSnapshotsTest-130905406 None] Update group completed successfully.
Sep 30 15:45:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-8782121a-f91d-49f6-be45-104aa0103745 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8782121a-f91d-49f6-be45-104aa0103745 tempest-GroupSnapshotsTest-130905406 None] Update group completed successfully.
Sep 30 15:45:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-06121440-e41f-4587-b555-36eb1b617de7 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-06121440-e41f-4587-b555-36eb1b617de7 tempest-GroupSnapshotsTest-130905406 None] Update group completed successfully.
Sep 30 15:45:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] GroupSnapshot 031be843-bb18-4663-ad91-0dc15f060907: creating.
Sep 30 15:45:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Group snapshot 031be843-bb18-4663-ad91-0dc15f060907: creating. {{(pid=80302) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Creating offline snapshot b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 of volume 5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[122439a6-5c21-46db-9a79-d8b309dba8ca]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:29 devstack quobyte-client[80089]: System call "open" of process 93091 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e" returned: 0 in 0.183s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:29 devstack quobyte-client[80089]: System call "getattr" of process 93094 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:29 devstack quobyte-client[80089]: System call "lookup" of process 93094 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:29 devstack quobyte-client[80089]: System call "getattr" of process 93094 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:29 devstack quobyte-client[80089]: System call "open" of process 93094 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=94, name=volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 1G" returned: 0 in 0.124s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5a7855b0-bda9-485f-84e7-e5628127836e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img rebase -u -b volume-5a7855b0-bda9-485f-84e7-e5628127836e -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" returned: 0 in 0.053s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.info" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.info" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.495s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Creating offline snapshot bd079a48-0e29-4f1b-ba6d-388f30fb1564 of volume ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1ebddd-0bae-46cc-9707-7542439a8019]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53" returned: 0 in 0.185s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack quobyte-client[80089]: System call "getattr" of process 93107 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:30 devstack quobyte-client[80089]: System call "open" of process 93107 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:30 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=96, name=volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 1G" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee993b62-52a5-4a6f-905b-280169bdec53 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img rebase -u -b volume-ee993b62-52a5-4a6f-905b-280169bdec53 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564" returned: 0 in 0.064s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.info" returned: 0 in 0.045s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.info" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.565s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:30 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-66b90e86-071f-4078-9baf-d365b9cb5b9d tempest-GroupSnapshotsTest-130905406 None] group_snapshot 031be843-bb18-4663-ad91-0dc15f060907: created successfully
Sep 30 15:45:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] group_snapshot 031be843-bb18-4663-ad91-0dc15f060907: deleting
Sep 30 15:45:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] group_snapshot 031be843-bb18-4663-ad91-0dc15f060907: deleting {{(pid=80302) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-5a7855b0-bda9-485f-84e7-e5628127836e" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-5a7855b0-bda9-485f-84e7-e5628127836e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Deleting offline snapshot b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 of volume 5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] snapshot_file for this snap is: volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cde6b3-1100-4fa3-84f4-c5c4f2d077fe]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a7855b0-bda9-485f-84e7-e5628127836e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[612df351-14b5-4297-a042-a3ea76a9a97d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack quobyte-client[80089]: System call "lookup" of process 93121 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:32 devstack quobyte-client[80089]: System call "open" of process 93121 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e" returned: 0 in 0.173s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" returned: 0 in 0.113s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e.b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-b4f9f9f4-8e7b-44f8-9cd1-f3c08800fdc2" released by "_delete_snapshot" :: held 0.570s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-5a7855b0-bda9-485f-84e7-e5628127836e" released by "delete_snapshot" :: held 0.583s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-ee993b62-52a5-4a6f-905b-280169bdec53" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-ee993b62-52a5-4a6f-905b-280169bdec53" acquired by "delete_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-bd079a48-0e29-4f1b-ba6d-388f30fb1564" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-bd079a48-0e29-4f1b-ba6d-388f30fb1564" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Deleting offline snapshot bd079a48-0e29-4f1b-ba6d-388f30fb1564 of volume ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] snapshot_file for this snap is: volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[68abbddc-82ad-4e19-bb1a-264a09d59923]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee993b62-52a5-4a6f-905b-280169bdec53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[859beac8-f3f8-40b3-9c4c-6b6d7cafae55]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack quobyte-client[80089]: System call "getattr" of process 93131 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564" returned: 0 in 0.078s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53.bd079a48-0e29-4f1b-ba6d-388f30fb1564" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-bd079a48-0e29-4f1b-ba6d-388f30fb1564" released by "_delete_snapshot" :: held 0.437s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-ee993b62-52a5-4a6f-905b-280169bdec53" released by "delete_snapshot" :: held 0.449s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:32 devstack cinder-volume[80302]: WARNING cinder.quota [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1881546387 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1881546387, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:32 devstack cinder-volume[80302]: WARNING cinder.quota [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1881546387 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1881546387, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:32 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Created reservations ['1b33dd78-811f-41a6-94cd-4c74a5aedf56', 'f051bdf3-11d7-4f50-bede-9c1c6131cb7d', 'ae28c874-7b13-4a59-a3b0-daf5f1a0c7aa', '637c0d93-e8bd-4899-97fb-38431cb4188d'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:33 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] Created reservations ['85f9c688-0f2a-4176-8bf4-aa16fc006ff0', 'aae36d9d-251a-4699-9320-6d9d0701e02d', 'd2baea88-9903-4e50-ba56-0bf4cda8e65a', '00ed3cff-a23d-46c1-af06-e3718945c352'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2ff90d56-d8da-4b14-8639-f5822c77fc3b tempest-GroupSnapshotsTest-130905406 None] group_snapshot 031be843-bb18-4663-ad91-0dc15f060907: deleted successfully
Sep 30 15:45:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-5a7855b0-bda9-485f-84e7-e5628127836e" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-5a7855b0-bda9-485f-84e7-e5628127836e" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b54804a-c578-471a-b038-1790761c24e0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-5a7855b0-bda9-485f-84e7-e5628127836e" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-5a7855b0-bda9-485f-84e7-e5628127836e" released by "delete_volume" :: held 0.228s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-ee993b62-52a5-4a6f-905b-280169bdec53" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-ee993b62-52a5-4a6f-905b-280169bdec53" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1851b1f2-8803-4399-9411-7b74a352bbc6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ee993b62-52a5-4a6f-905b-280169bdec53" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-ee993b62-52a5-4a6f-905b-280169bdec53" released by "delete_volume" :: held 0.193s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['e7136a5b-e446-44f2-9854-8a3110471d47'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:34 devstack cinder-volume[80302]: WARNING cinder.quota [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1881546387 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1881546387, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['0ff279dd-f783-4dcb-a71d-a2d60d76237f', 'bcf35e90-d0b1-4435-a51b-ffe65376dcc3', '0a5f55bf-0534-4628-9fd9-b3c2cc868f74', 'e96b8079-2ef9-4f3d-9b10-df3484006b43'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['4edf9705-1c35-41ab-8815-b8b657c6b8db', '4fe7d3af-7564-4993-8e33-6423ca7e4d61', 'b3138a18-afdb-47d0-a743-058b0f27afd1', '389f807c-5d04-4842-8333-b22cb9bd9ef0'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:35 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:45:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-46979408-791c-49db-b989-8d18447affa7 tempest-GroupSnapshotsTest-130905406 None] Delete group completed successfully.
Sep 30 15:45:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a79d6dcb-6de2-49d1-bdf8-cda8f0e4ccb5 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a79d6dcb-6de2-49d1-bdf8-cda8f0e4ccb5 tempest-GroupSnapshotsTest-130905406 None] Group tempest-GroupSnapshotsTest-Group-673173708: creating
Sep 30 15:45:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a79d6dcb-6de2-49d1-bdf8-cda8f0e4ccb5 tempest-GroupSnapshotsTest-130905406 None] Group tempest-GroupSnapshotsTest-Group-673173708: created successfully
Sep 30 15:45:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a79d6dcb-6de2-49d1-bdf8-cda8f0e4ccb5 tempest-GroupSnapshotsTest-130905406 None] Create group completed successfully.
Sep 30 15:45:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (6c86275a-be7e-4ab8-acb1-90e48334e9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812700a6-e9ca-4c22-b532-8124c0e66077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812700a6-e9ca-4c22-b532-8124c0e66077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589718942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=618c5952-9734-479d-aa3e-0ad23b538059,host='devstack@QuobyteHD#QuobyteHD',id=cc41d716-2eba-45c3-b1b6-67066652a4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:37Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ba007cf-7b2d-4768-9619-970220c4b8eb),volume_type_id=4ba007cf-7b2d-4768-9619-970220c4b8eb)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e8ca96-71b7-4b3d-899f-f4ba1b468cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e8ca96-71b7-4b3d-899f-f4ba1b468cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fc67f7-424d-4dc3-ac5f-7c2c448541b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fc67f7-424d-4dc3-ac5f-7c2c448541b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc41d716-2eba-45c3-b1b6-67066652a4ea', 'volume_name': 'volume-cc41d716-2eba-45c3-b1b6-67066652a4ea', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23b3d79-1fdd-47c8-979c-00fed37733c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23b3d79-1fdd-47c8-979c-00fed37733c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf00f86-0600-4eec-9a7e-85722c94857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:37 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Volume cc41d716-2eba-45c3-b1b6-67066652a4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc41d716-2eba-45c3-b1b6-67066652a4ea', 'volume_size': 1}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=618c5952-9734-479d-aa3e-0ad23b538059,created_at=2025-09-30T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589718942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=618c5952-9734-479d-aa3e-0ad23b538059,host='devstack@QuobyteHD#QuobyteHD',id=cc41d716-2eba-45c3-b1b6-67066652a4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556fc106d7bd48b58b933705c6e7ec09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:45:37Z,use_quota=True,user_id='c9fbbbf3e00f464ba2efc88f595f069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ba007cf-7b2d-4768-9619-970220c4b8eb),volume_type_id=4ba007cf-7b2d-4768-9619-970220c4b8eb)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Creating volume cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:45:37 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:37 devstack quobyte-client[80089]: System call "lookup" of process 93147 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:37 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=98, name=volume-cc41d716-2eba-45c3-b1b6-67066652a4ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea 1073741824" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] <== create_volume: return (192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.195s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf00f86-0600-4eec-9a7e-85722c94857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc41d716-2eba-45c3-b1b6-67066652a4ea', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac563ba3-db28-4033-b931-7494c24d771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:45:37 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Volume volume-cc41d716-2eba-45c3-b1b6-67066652a4ea (cc41d716-2eba-45c3-b1b6-67066652a4ea): created successfully
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac563ba3-db28-4033-b931-7494c24d771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:45:37 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Flow 'volume_create_manager' (6c86275a-be7e-4ab8-acb1-90e48334e9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:45:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e41604b6-9c31-412d-bdcb-9353c8a5afd4 tempest-GroupSnapshotsTest-130905406 None] Created volume successfully.
Sep 30 15:45:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] GroupSnapshot d67987b2-7fc2-4c3e-a4e5-5a3a8a060f49: creating.
Sep 30 15:45:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Group snapshot d67987b2-7fc2-4c3e-a4e5-5a3a8a060f49: creating. {{(pid=80302) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Creating offline snapshot a29a26e9-8a47-40fd-a5cd-251a78681626 of volume cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec61e2d-be07-4883-a08c-08ea6814deef]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack quobyte-client[80089]: System call "getattr" of process 93151 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea" returned: 0 in 0.168s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack quobyte-client[80089]: System call "getattr" of process 93154 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:38 devstack quobyte-client[80089]: System call "lookup" of process 93154 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:38 devstack quobyte-client[80089]: System call "getattr" of process 93154 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:38 devstack quobyte-client[80089]: System call "open" of process 93154 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:38 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=99, name=volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 1G" returned: 0 in 0.116s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cc41d716-2eba-45c3-b1b6-67066652a4ea -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack quobyte-client[80089]: System call "getattr" of process 93157 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img rebase -u -b volume-cc41d716-2eba-45c3-b1b6-67066652a4ea -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626" returned: 0 in 0.061s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.info" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.info" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.482s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b57912df-ea2b-4bd3-87e5-96c5cf0a7d56 tempest-GroupSnapshotsTest-130905406 None] group_snapshot d67987b2-7fc2-4c3e-a4e5-5a3a8a060f49: created successfully
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:45:39 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] group_snapshot d67987b2-7fc2-4c3e-a4e5-5a3a8a060f49: deleting
Sep 30 15:45:39 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] group_snapshot d67987b2-7fc2-4c3e-a4e5-5a3a8a060f49: deleting {{(pid=80302) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-cc41d716-2eba-45c3-b1b6-67066652a4ea" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-cc41d716-2eba-45c3-b1b6-67066652a4ea" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-a29a26e9-8a47-40fd-a5cd-251a78681626" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-a29a26e9-8a47-40fd-a5cd-251a78681626" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Deleting offline snapshot a29a26e9-8a47-40fd-a5cd-251a78681626 of volume cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] snapshot_file for this snap is: volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a4f535-0aa6-4245-a4b5-1c71dca1aecc]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626" returned: 0 in 0.175s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc41d716-2eba-45c3-b1b6-67066652a4ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec54914-6920-4d30-a58d-7873b241e7e2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea" returned: 0 in 0.158s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:40 devstack quobyte-client[80089]: System call "getattr" of process 93171 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:40 devstack quobyte-client[80089]: System call "open" of process 93171 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626" returned: 0 in 0.076s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea.a29a26e9-8a47-40fd-a5cd-251a78681626" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-a29a26e9-8a47-40fd-a5cd-251a78681626" released by "_delete_snapshot" :: held 0.511s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-cc41d716-2eba-45c3-b1b6-67066652a4ea" released by "delete_snapshot" :: held 0.527s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:40 devstack cinder-volume[80302]: WARNING cinder.quota [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-693031375 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-693031375, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:40 devstack cinder-volume[80302]: WARNING cinder.quota [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-693031375 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-693031375, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['461ff643-f170-4148-b107-650e03ca98c0', '8ec15233-c820-4421-9961-46dd1af42dcf', '2114e5b7-b2a3-4531-a0bb-519e612f12e1', '978bdf7a-51e5-4286-adb0-a440f39524d8'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3b63fcb8-1ce9-411f-ac2c-4043e75d0355 tempest-GroupSnapshotsTest-130905406 None] group_snapshot d67987b2-7fc2-4c3e-a4e5-5a3a8a060f49: deleted successfully
Sep 30 15:45:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "cinder-quobyte-cc41d716-2eba-45c3-b1b6-67066652a4ea" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-cc41d716-2eba-45c3-b1b6-67066652a4ea" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[adacb4ab-a7ea-47b4-9620-e6d11b202694]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:45:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cc41d716-2eba-45c3-b1b6-67066652a4ea" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Lock "cinder-quobyte-cc41d716-2eba-45c3-b1b6-67066652a4ea" released by "delete_volume" :: held 0.222s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['a6b388a2-846d-4824-a46d-b7d01c8245a2'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:41 devstack cinder-volume[80302]: WARNING cinder.quota [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-693031375 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-693031375, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Created reservations ['30cc5abc-8cd6-43f3-9070-80ffcbc38590', '869bf959-6ce1-4d3e-885b-4206c82cad63', '23b557f7-b320-4622-8f66-15dc72a72f5a', '0ba68dc7-a3af-49be-b61e-93b5580ed072'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:45:41 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:45:41 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-977b33a7-95f3-4e23-a145-8c965b45e0f2 tempest-GroupSnapshotsTest-130905406 None] Delete group completed successfully.
Sep 30 15:45:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=85,cinder:SELECT=99,cinder:INSERT=21,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:45:51 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=102,cinder:SELECT=99,cinder:INSERT=19,cinder:DELETE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:45:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:45:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Flow 'volume_create_manager' (159d3868-a496-4865-9a07-683452ef961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711164e1-e73b-4382-9374-4c5dff150d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711164e1-e73b-4382-9374-4c5dff150d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-65469814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3271ebae-678b-4a7c-b6e1-8b045a3b64ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694c99d7d4ff48dc346bfb2198fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:04Z,use_quota=True,user_id='21df2b8590e440bfbdea8041fad91f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e24ad9f-dd1a-4b5d-837a-664c752c6c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e24ad9f-dd1a-4b5d-837a-664c752c6c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946a80e9-2101-4e62-aaaa-216e9d01adcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946a80e9-2101-4e62-aaaa-216e9d01adcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3271ebae-678b-4a7c-b6e1-8b045a3b64ee', 'volume_name': 'volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097ea237-efab-4c94-ba2d-f7f52d922847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097ea237-efab-4c94-ba2d-f7f52d922847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a752d58-2ce6-45f9-a774-04cecec6c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:04 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Volume 3271ebae-678b-4a7c-b6e1-8b045a3b64ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee', 'volume_size': 1}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-65469814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3271ebae-678b-4a7c-b6e1-8b045a3b64ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694c99d7d4ff48dc346bfb2198fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:04Z,use_quota=True,user_id='21df2b8590e440bfbdea8041fad91f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Creating volume 3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:04 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:04 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=101, name=volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee 1073741824" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] <== create_volume: return (159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.161s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a752d58-2ce6-45f9-a774-04cecec6c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5ab202-64cc-41b4-abd1-b0f90f8a0cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:04 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Volume volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee (3271ebae-678b-4a7c-b6e1-8b045a3b64ee): created successfully
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5ab202-64cc-41b4-abd1-b0f90f8a0cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Flow 'volume_create_manager' (159d3868-a496-4865-9a07-683452ef961d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0537a3f4-d2c8-4d47-af77-cf443a9ab912 tempest-VolumesDeleteCascade-1470221123 None] Created volume successfully.
Sep 30 15:46:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Creating offline snapshot 796a8e4f-c3aa-4f48-995d-6219d25f5cfb of volume 3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a23c604-dcef-40df-95e7-1b8aefaed7e4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:05 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=102, name=volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb 1G" returned: 0 in 0.099s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img rebase -u -b volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.050s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.info" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.info" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.414s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f48103e7-f4e0-403f-862c-00c946ab72d9 tempest-VolumesDeleteCascade-1470221123 None] Create snapshot completed successfully
Sep 30 15:46:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Creating offline snapshot b1ab3585-38dc-4c50-9828-a587d6daa81a of volume 3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf09553c-8f95-49c0-8edc-56679da2018a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:07 devstack quobyte-client[80089]: System call "statfs" of process 93239 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:07 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=104, name=volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a 1G" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img rebase -u -b volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.377s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:07 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-75370d71-38c6-43b6-98d1-aa4218c2f5d7 tempest-VolumesDeleteCascade-1470221123 None] Create snapshot completed successfully
Sep 30 15:46:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-3271ebae-678b-4a7c-b6e1-8b045a3b64ee-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-3271ebae-678b-4a7c-b6e1-8b045a3b64ee-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:07 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Performing cascade delete. {{(pid=80302) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 30 15:46:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-796a8e4f-c3aa-4f48-995d-6219d25f5cfb-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-796a8e4f-c3aa-4f48-995d-6219d25f5cfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:08 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-796a8e4f-c3aa-4f48-995d-6219d25f5cfb" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-796a8e4f-c3aa-4f48-995d-6219d25f5cfb" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Deleting offline snapshot 796a8e4f-c3aa-4f48-995d-6219d25f5cfb of volume 3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] snapshot_file for this snap is: volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb45e42-1132-4a57-a8ab-3c489d54f707]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.130s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdd4bd-42fa-4016-b25e-2274840270c7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[e816faff-8050-4c8b-8bac-877ac2ee677f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.149s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dff184e-0a4b-41c5-871c-54061af6321a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[58115fc3-7d5a-4d04-8c84-886bd200cc71]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack quobyte-client[80089]: System call "getattr" of process 93269 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:08 devstack quobyte-client[80089]: System call "lookup" of process 93269 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:08 devstack quobyte-client[80089]: System call "getattr" of process 93269 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.068s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.796a8e4f-c3aa-4f48-995d-6219d25f5cfb" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a -F qcow2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img rebase -u -b volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a -F qcow2" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-796a8e4f-c3aa-4f48-995d-6219d25f5cfb" released by "_delete_snapshot" :: held 0.920s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" released by "delete_snapshot" :: held 0.930s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:08 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Created reservations ['97da1313-3e88-4610-b713-1f94ca3f3c20', '4539e5fa-0dee-4869-8b7d-0cfa64e3d59d', '8e30da83-3a4c-4bba-8d47-a2b8cc38ffcf', 'cfcc8c64-7240-45ac-b01f-0e5305f0db4b'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Delete snapshot completed successfully.
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-796a8e4f-c3aa-4f48-995d-6219d25f5cfb-delete_snapshot" released by "delete_snapshot" :: held 1.024s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-b1ab3585-38dc-4c50-9828-a587d6daa81a-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-b1ab3585-38dc-4c50-9828-a587d6daa81a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-b1ab3585-38dc-4c50-9828-a587d6daa81a" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-b1ab3585-38dc-4c50-9828-a587d6daa81a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Deleting offline snapshot b1ab3585-38dc-4c50-9828-a587d6daa81a of volume 3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] snapshot_file for this snap is: volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b214d-c1ee-48eb-b8c8-312ce46c17a6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.135s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d3a995-6a29-4dc4-944a-52c9f5c48b62]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.157s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.070s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee.b1ab3585-38dc-4c50-9828-a587d6daa81a" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-b1ab3585-38dc-4c50-9828-a587d6daa81a" released by "_delete_snapshot" :: held 0.437s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" released by "delete_snapshot" :: held 0.449s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Created reservations ['14f35273-cd76-4064-b1b7-513d37d444ea', 'ad72be3f-c6c6-48aa-920b-d528ba81c4ea', 'fd3182d3-3d9b-444f-9577-18540ef49d70', 'fc2fb48c-08ef-468e-a550-4f2ce3221b1e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Delete snapshot completed successfully.
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-b1ab3585-38dc-4c50-9828-a587d6daa81a-delete_snapshot" released by "delete_snapshot" :: held 0.555s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Snapshots deleted, issuing volume delete {{(pid=80302) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad70873-7fa4-439d-bf3c-a2ffa87ee369]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-3271ebae-678b-4a7c-b6e1-8b045a3b64ee" released by "delete_volume" :: held 0.216s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Created reservations ['7dc8f71f-c040-4197-8f9a-1182df709ae4', '616b8cfc-ca13-45e3-8b7c-c94adc817f7e', 'd022ee82-592e-4f02-94da-744f0e8a3daf', 'adfa08ab-d310-47de-a2d4-594517dfbce9'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Deleted volume successfully.
Sep 30 15:46:09 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6308dffc-8838-4a22-889f-91c8aeea3103 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-3271ebae-678b-4a7c-b6e1-8b045a3b64ee-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Flow 'volume_create_manager' (93d16f51-44d8-4c51-8597-3c72a74d62ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c896928-cc5f-4607-b660-ef84b1bb654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c896928-cc5f-4607-b660-ef84b1bb654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1829213738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ade52f-1f51-48e2-8b9e-797d1a32d612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694c99d7d4ff48dc346bfb2198fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:11Z,use_quota=True,user_id='21df2b8590e440bfbdea8041fad91f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445bca28-ea50-4484-ab63-25ff4a0c703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445bca28-ea50-4484-ab63-25ff4a0c703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f7018-a3b2-499c-bc8d-2e7f1bcd554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f7018-a3b2-499c-bc8d-2e7f1bcd554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ade52f-1f51-48e2-8b9e-797d1a32d612', 'volume_name': 'volume-90ade52f-1f51-48e2-8b9e-797d1a32d612', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0cd78d-d4e0-4cf3-b7d7-419b6b6cb7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0cd78d-d4e0-4cf3-b7d7-419b6b6cb7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41901441-9197-4db6-87bd-adde3e5c3822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:10 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Volume 90ade52f-1f51-48e2-8b9e-797d1a32d612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ade52f-1f51-48e2-8b9e-797d1a32d612', 'volume_size': 1}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1829213738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ade52f-1f51-48e2-8b9e-797d1a32d612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694c99d7d4ff48dc346bfb2198fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:11Z,use_quota=True,user_id='21df2b8590e440bfbdea8041fad91f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Creating volume 90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:10 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:10 devstack quobyte-client[80089]: System call "create" of process 93301 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:10 devstack quobyte-client[80089]: System call "getattr" of process 93301 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:10 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=105, name=volume-90ade52f-1f51-48e2-8b9e-797d1a32d612, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 1073741824" returned: 0 in 0.121s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] <== create_volume: return (146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.148s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41901441-9197-4db6-87bd-adde3e5c3822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ade52f-1f51-48e2-8b9e-797d1a32d612', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbab21be-00b7-4f4a-9f9d-6b7c40f3b37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:10 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Volume volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 (90ade52f-1f51-48e2-8b9e-797d1a32d612): created successfully
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbab21be-00b7-4f4a-9f9d-6b7c40f3b37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Flow 'volume_create_manager' (93d16f51-44d8-4c51-8597-3c72a74d62ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-24759f47-c727-4a46-977e-4d64f8b50614 tempest-VolumesDeleteCascade-1470221123 None] Created volume successfully.
Sep 30 15:46:11 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:11 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Creating offline snapshot 0a07476f-9e7a-4c94-8f73-90c28f97bf14 of volume 90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:46:11 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea7fa8-d4f1-45c7-975c-4c8e3deff373]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.128s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack quobyte-client[80089]: System call "setlk" of process 93343 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:12 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=106, name=volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 1G" returned: 0 in 0.087s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img rebase -u -b volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img rebase -u -b volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.027s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.info" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.info" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.392s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:12 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7f841edf-2485-48ac-acb5-ff0b6b236c90 tempest-VolumesDeleteCascade-1470221123 None] Create snapshot completed successfully
Sep 30 15:46:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Flow 'volume_create_manager' (e7584af3-3de3-4e61-8110-64f08728fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3593bb5-7565-45a3-9c82-79b4306cf032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3593bb5-7565-45a3-9c82-79b4306cf032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-248830327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694c99d7d4ff48dc346bfb2198fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a07476f-9e7a-4c94-8f73-90c28f97bf14,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:13Z,use_quota=True,user_id='21df2b8590e440bfbdea8041fad91f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6108d4be-fd90-47aa-be1d-d51b060a4bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6108d4be-fd90-47aa-be1d-d51b060a4bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7a01a1-9aac-44bf-b00c-299df942c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7a01a1-9aac-44bf-b00c-299df942c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a', 'volume_name': 'volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a', 'volume_size': 1, 'snapshot_id': '0a07476f-9e7a-4c94-8f73-90c28f97bf14'}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd76c908-3594-4174-b106-117da69e1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd76c908-3594-4174-b106-117da69e1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0536e5e0-8573-4606-ab68-7306d362d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:13 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Volume e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a', 'volume_size': 1, 'snapshot_id': '0a07476f-9e7a-4c94-8f73-90c28f97bf14'}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-0a07476f-9e7a-4c94-8f73-90c28f97bf14-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" by "_create_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-0a07476f-9e7a-4c94-8f73-90c28f97bf14-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Creating volume e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a from snapshot 0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:360}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" by "_copy_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] snapshot: 0a07476f-9e7a-4c94-8f73-90c28f97bf14, volume: e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a,  {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a045bfb-f981-4b45-8bee-853061049ec6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.119s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90ade52f-1f51-48e2-8b9e-797d1a32d612(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:424}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Creating direct copy from snapshot {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:432}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a8db20-9972-4c41-b3ae-d85100c598a5]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG cinder.utils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a not found in is_blk_device check {{(pid=80302) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 15:46:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:13 devstack quobyte-client[80089]: System call "getlk" of process 93359 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:13 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=108, name=volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" returned: 0 in 2.057s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9878f6de-aeca-4b0e-bee8-22066033d862]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.251s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Image conversion details: src /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:46:15 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Converted 1024.00 MB image at 497.58 MB/s
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" released by "_copy_volume_from_snapshot" :: held 2.636s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-0a07476f-9e7a-4c94-8f73-90c28f97bf14-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" released by "_create_volume_from_snapshot" :: held 2.649s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.656s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0536e5e0-8573-4606-ab68-7306d362d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a', 'volume_size': 1, 'snapshot_id': '0a07476f-9e7a-4c94-8f73-90c28f97bf14'}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b320f88c-8ec0-4507-b2b2-587360d8031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:15 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Volume volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a (e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a): created successfully
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b320f88c-8ec0-4507-b2b2-587360d8031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Flow 'volume_create_manager' (e7584af3-3de3-4e61-8110-64f08728fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-5a38f15a-5e0d-42fa-bd1f-8ff7ada9b55e tempest-VolumesDeleteCascade-1470221123 None] Created volume successfully.
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-90ade52f-1f51-48e2-8b9e-797d1a32d612-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-90ade52f-1f51-48e2-8b9e-797d1a32d612-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Performing cascade delete. {{(pid=80302) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-0a07476f-9e7a-4c94-8f73-90c28f97bf14-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-0a07476f-9e7a-4c94-8f73-90c28f97bf14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-90ade52f-1f51-48e2-8b9e-797d1a32d612" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-90ade52f-1f51-48e2-8b9e-797d1a32d612" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-0a07476f-9e7a-4c94-8f73-90c28f97bf14" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-0a07476f-9e7a-4c94-8f73-90c28f97bf14" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Deleting offline snapshot 0a07476f-9e7a-4c94-8f73-90c28f97bf14 of volume 90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] snapshot_file for this snap is: volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d665b-a891-4571-9962-7f24661ac80b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90ade52f-1f51-48e2-8b9e-797d1a32d612(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a466e2-39d3-46c0-aad8-bba8f4fa5380]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.068s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612.0a07476f-9e7a-4c94-8f73-90c28f97bf14" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-0a07476f-9e7a-4c94-8f73-90c28f97bf14" released by "_delete_snapshot" :: held 0.415s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-90ade52f-1f51-48e2-8b9e-797d1a32d612" released by "delete_snapshot" :: held 0.430s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Created reservations ['d93d18f1-4933-4060-abd2-b3659ad0350e', '05b0c12f-509c-465f-baf9-ad79a217f883', '38fefe9a-e840-4249-a7fd-c92e3706528f', 'e4c9c0dc-ba8f-4cca-ad35-055444e26ed5'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Delete snapshot completed successfully.
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-0a07476f-9e7a-4c94-8f73-90c28f97bf14-delete_snapshot" released by "delete_snapshot" :: held 0.528s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Snapshots deleted, issuing volume delete {{(pid=80302) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-90ade52f-1f51-48e2-8b9e-797d1a32d612" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-90ade52f-1f51-48e2-8b9e-797d1a32d612" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[287d14cd-6e4c-482d-b5b5-9c654a72a865]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-90ade52f-1f51-48e2-8b9e-797d1a32d612" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-90ade52f-1f51-48e2-8b9e-797d1a32d612" released by "delete_volume" :: held 0.181s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Created reservations ['f2c7dbc2-7e43-4a9d-8ec3-8f91e3c526a5', '2ca1f781-b544-4748-9dfc-309ab9a0fcd7', '6fe9dbee-7061-4b8d-a43b-c88adcc575f2', '7d78f23f-aa52-4dfc-a409-cd0ad8796445'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Deleted volume successfully.
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ef57619d-f173-4597-afd8-b87ca1d23807 tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-90ade52f-1f51-48e2-8b9e-797d1a32d612-delete_volume" released by "delete_volume" :: held 0.902s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:17 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "cinder-quobyte-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d4235b-26a3-480e-87dd-374e5ad6676b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-quobyte-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a" released by "delete_volume" :: held 0.176s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Created reservations ['646cceab-fb6d-4207-8558-8ad8d3583ba0', '90893d10-5486-419d-a806-a04f58545f8e', 'dba7bb41-46b0-462d-a75d-15103fc1670b', '950ca130-6ea0-4898-bfe6-c37be8f6eda6'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Deleted volume successfully.
Sep 30 15:46:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-65dc96d0-2099-4dc8-916e-bde5c69f3ccc tempest-VolumesDeleteCascade-1470221123 None] Lock "cinder-e97f468a-daec-4ddd-8fa9-d9cbee1a4f8a-delete_volume" released by "delete_volume" :: held 0.328s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Flow 'volume_create_manager' (6cdd0664-f04b-4116-85d9-5e2cd37ba756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a823bc2-d63f-4477-a01b-b9661786fcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a823bc2-d63f-4477-a01b-b9661786fcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-733265764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136cfefd-d188-4a4b-958d-76a9b582baa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963570fad5a44c2987ab466a063ec4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:21Z,use_quota=True,user_id='60e505db87ba443b93d1d89837ba612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca51fd7-4ca9-406f-aeb0-fe675c07ce18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca51fd7-4ca9-406f-aeb0-fe675c07ce18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146fd28d-09d2-4795-8c6e-bcb5d61dfc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146fd28d-09d2-4795-8c6e-bcb5d61dfc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136cfefd-d188-4a4b-958d-76a9b582baa1', 'volume_name': 'volume-136cfefd-d188-4a4b-958d-76a9b582baa1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121f89a4-7207-4028-bb04-118e8cc8f72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121f89a4-7207-4028-bb04-118e8cc8f72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e36f12-e534-424c-b5ea-db9167f1d878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:21 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Volume 136cfefd-d188-4a4b-958d-76a9b582baa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136cfefd-d188-4a4b-958d-76a9b582baa1', 'volume_size': 1}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-733265764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136cfefd-d188-4a4b-958d-76a9b582baa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963570fad5a44c2987ab466a063ec4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:21Z,use_quota=True,user_id='60e505db87ba443b93d1d89837ba612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Creating volume 136cfefd-d188-4a4b-958d-76a9b582baa1 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:21 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:21 devstack quobyte-client[80089]: System call "getattr" of process 93400 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:21 devstack quobyte-client[80089]: System call "getattr" of process 93400 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:21 devstack quobyte-client[80089]: System call "lookup" of process 93400 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:21 devstack quobyte-client[80089]: System call "create" of process 93400 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:21 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=109, name=volume-136cfefd-d188-4a4b-958d-76a9b582baa1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1 1073741824" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] <== create_volume: return (174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.176s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e36f12-e534-424c-b5ea-db9167f1d878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136cfefd-d188-4a4b-958d-76a9b582baa1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1750e3e9-ea4f-4adf-a2d7-fe042bfd3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:21 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Volume volume-136cfefd-d188-4a4b-958d-76a9b582baa1 (136cfefd-d188-4a4b-958d-76a9b582baa1): created successfully
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1750e3e9-ea4f-4adf-a2d7-fe042bfd3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Flow 'volume_create_manager' (6cdd0664-f04b-4116-85d9-5e2cd37ba756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7561a41a-b17c-409b-ac3e-34a69013388a tempest-VolumesMetadataTest-1061759716 None] Created volume successfully.
Sep 30 15:46:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Acquiring lock "cinder-136cfefd-d188-4a4b-958d-76a9b582baa1-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Lock "cinder-136cfefd-d188-4a4b-958d-76a9b582baa1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Acquiring lock "cinder-quobyte-136cfefd-d188-4a4b-958d-76a9b582baa1" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Lock "cinder-quobyte-136cfefd-d188-4a4b-958d-76a9b582baa1" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[446dbcd4-7cd4-4f31-b195-5fe8b05ed0f7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-136cfefd-d188-4a4b-958d-76a9b582baa1" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Lock "cinder-quobyte-136cfefd-d188-4a4b-958d-76a9b582baa1" released by "delete_volume" :: held 0.211s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Created reservations ['70fb41d6-ea77-4637-ae4f-a634251a3f0d', '9390073c-5a52-43b3-b2d6-545247bbd701', 'fc884933-409c-4ee7-aa83-90cc2c353b7d', '59a64e80-b668-4975-9702-03b77a0b082a'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Deleted volume successfully.
Sep 30 15:46:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-975d4e35-12a6-4b59-98e2-56775002c92c tempest-VolumesMetadataTest-1061759716 None] Lock "cinder-136cfefd-d188-4a4b-958d-76a9b582baa1-delete_volume" released by "delete_volume" :: held 0.346s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Flow 'volume_create_manager' (225f696b-7da6-4891-89f2-b7a62f2bae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e2649b-cd13-4147-947b-78c197c3d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e2649b-cd13-4147-947b-78c197c3d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1443442114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c3454e-0451-46f8-9940-7217e9306afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4c0eadbbab41ae9c3282a77416e96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:26Z,use_quota=True,user_id='fea006bd9a104ebf9136d5adc13debbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e48d50-4d00-4c29-93c0-bc7635b29170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e48d50-4d00-4c29-93c0-bc7635b29170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242592ec-8c38-42b9-a347-b7023ab70018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242592ec-8c38-42b9-a347-b7023ab70018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c3454e-0451-46f8-9940-7217e9306afa', 'volume_name': 'volume-02c3454e-0451-46f8-9940-7217e9306afa', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485e8a3e-a52b-46af-a24f-8433e278326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485e8a3e-a52b-46af-a24f-8433e278326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13a6902-72ad-403d-af7b-557e94e6a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:26 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Volume 02c3454e-0451-46f8-9940-7217e9306afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c3454e-0451-46f8-9940-7217e9306afa', 'volume_size': 1}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1443442114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c3454e-0451-46f8-9940-7217e9306afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4c0eadbbab41ae9c3282a77416e96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:26Z,use_quota=True,user_id='fea006bd9a104ebf9136d5adc13debbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Creating volume 02c3454e-0451-46f8-9940-7217e9306afa {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:26 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:26 devstack quobyte-client[80089]: System call "ioctl" of process 93420 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:26 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=110, name=volume-02c3454e-0451-46f8-9940-7217e9306afa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa 1073741824" returned: 0 in 0.113s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] <== create_volume: return (143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.145s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13a6902-72ad-403d-af7b-557e94e6a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c3454e-0451-46f8-9940-7217e9306afa', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3abc6d-2ce0-4f99-9b67-e8510737b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:26 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Volume volume-02c3454e-0451-46f8-9940-7217e9306afa (02c3454e-0451-46f8-9940-7217e9306afa): created successfully
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3abc6d-2ce0-4f99-9b67-e8510737b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Flow 'volume_create_manager' (225f696b-7da6-4891-89f2-b7a62f2bae43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-54aeb701-7450-44fd-9551-f904b54b6640 tempest-VolumesTransfersV355Test-721316336 None] Created volume successfully.
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad46da-2b9a-4fb6-a8d1-27e15801e833]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.161s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:27 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-7367f07f-d27d-4538-a179-d094484cb623', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '457e8a99-9739-4e09-803b-46a159e06b0c', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:46:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-65c003c2-376e-47e5-a564-0a0287f67d0a req-170a6780-3c57-4eed-8ea3-84649c7454c3 tempest-TestInstancesWithCinderVolumes-1664779642 None] attachment_update completed successfully.
Sep 30 15:46:27 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-11910e29-4792-41f5-9082-a0064b812137 tempest-VolumesTransfersV355Test-1811822384 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-11910e29-4792-41f5-9082-a0064b812137 tempest-VolumesTransfersV355Test-1811822384 None] Transfer volume completed successfully.
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Acquiring lock "cinder-02c3454e-0451-46f8-9940-7217e9306afa-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-02c3454e-0451-46f8-9940-7217e9306afa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Acquiring lock "cinder-quobyte-02c3454e-0451-46f8-9940-7217e9306afa" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-quobyte-02c3454e-0451-46f8-9940-7217e9306afa" acquired by "delete_volume" :: waited 0.005s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a1cae-0e07-4833-ba96-81f4a66fc1b4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-02c3454e-0451-46f8-9940-7217e9306afa" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-quobyte-02c3454e-0451-46f8-9940-7217e9306afa" released by "delete_volume" :: held 0.195s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Created reservations ['4f3a2c81-e3d6-4887-a786-428ca5e65d6c', '90b539f2-bed8-4c8c-9a96-6167ea100096', 'b31d3428-5330-48be-abae-fa5ca0e11ac8', '6b61658a-11ea-434a-b9d2-4518e7b38812'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:29 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Deleted volume successfully.
Sep 30 15:46:29 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-32c526c4-32a2-4559-bdc8-d069553626be tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-02c3454e-0451-46f8-9940-7217e9306afa-delete_volume" released by "delete_volume" :: held 0.377s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:30 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Flow 'volume_create_manager' (8dd6302d-f401-4fde-9752-14a146862cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346a9ec1-6901-425b-8cd2-2466cf2d8996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346a9ec1-6901-425b-8cd2-2466cf2d8996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1694324304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8abeca4-e2e5-4be7-a0b9-ac240deea42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4c0eadbbab41ae9c3282a77416e96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:30Z,use_quota=True,user_id='fea006bd9a104ebf9136d5adc13debbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653e2719-0ce2-4d6e-9ac2-d54b96b17925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653e2719-0ce2-4d6e-9ac2-d54b96b17925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd0661a-1acc-416a-b32e-1bbe87974c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd0661a-1acc-416a-b32e-1bbe87974c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8abeca4-e2e5-4be7-a0b9-ac240deea42e', 'volume_name': 'volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87c7191-fec6-4039-b771-5488bfc89e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87c7191-fec6-4039-b771-5488bfc89e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f054b794-8df8-49d6-828a-b25e612bc8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:30 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Volume f8abeca4-e2e5-4be7-a0b9-ac240deea42e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e', 'volume_size': 1}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1694324304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8abeca4-e2e5-4be7-a0b9-ac240deea42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4c0eadbbab41ae9c3282a77416e96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:30Z,use_quota=True,user_id='fea006bd9a104ebf9136d5adc13debbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Creating volume f8abeca4-e2e5-4be7-a0b9-ac240deea42e {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:30 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:30 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=111, name=volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e 1073741824" returned: 0 in 0.124s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] <== create_volume: return (150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.151s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f054b794-8df8-49d6-828a-b25e612bc8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d3f3e6-cfff-4365-aefe-cc2d5a838cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:30 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Volume volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e (f8abeca4-e2e5-4be7-a0b9-ac240deea42e): created successfully
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d3f3e6-cfff-4365-aefe-cc2d5a838cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Flow 'volume_create_manager' (8dd6302d-f401-4fde-9752-14a146862cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:30 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7987a4e1-16f8-4b4e-aab7-2937bdf10dae tempest-VolumesTransfersV355Test-721316336 None] Created volume successfully.
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Acquiring lock "cinder-f8abeca4-e2e5-4be7-a0b9-ac240deea42e-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-f8abeca4-e2e5-4be7-a0b9-ac240deea42e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Acquiring lock "cinder-quobyte-f8abeca4-e2e5-4be7-a0b9-ac240deea42e" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-quobyte-f8abeca4-e2e5-4be7-a0b9-ac240deea42e" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2d853-4858-4968-b926-e4334b1ce1b8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:31 devstack quobyte-client[80089]: System call "open" of process 93455 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e" returned: 0 in 0.169s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f8abeca4-e2e5-4be7-a0b9-ac240deea42e" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-quobyte-f8abeca4-e2e5-4be7-a0b9-ac240deea42e" released by "delete_volume" :: held 0.215s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Created reservations ['540f3b21-1511-4eb5-9009-96f161c87da7', '9f1ceef9-d977-4e40-965e-7c35c0520527', '81b6da50-8dec-4690-9553-97bdc6b92130', 'f93adc8b-ba4e-4d0f-b976-b5b443749a19'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Deleted volume successfully.
Sep 30 15:46:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e042ed6c-2e40-40f8-8b1a-0be5ca59993f tempest-VolumesTransfersV355Test-1736224890 None] Lock "cinder-f8abeca4-e2e5-4be7-a0b9-ac240deea42e-delete_volume" released by "delete_volume" :: held 0.383s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:36 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Flow 'volume_create_manager' (ee72804d-ff9f-480b-a176-5be0aef76d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac5b77c-0512-4bce-bf81-024eaee02760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac5b77c-0512-4bce-bf81-024eaee02760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1343898702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce8c9e7-c695-44a3-85b1-d20a0e3b6119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a283e85eab2422d97c26fb1314239f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:36Z,use_quota=True,user_id='af1ca3f6b63f4623b617239c7f96a8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed6afd6-4050-48b0-b932-e796b4c45fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed6afd6-4050-48b0-b932-e796b4c45fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd7e493-eb41-40a8-a80d-4ab9f0bfd42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd7e493-eb41-40a8-a80d-4ab9f0bfd42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce8c9e7-c695-44a3-85b1-d20a0e3b6119', 'volume_name': 'volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119', 'volume_size': 2}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44329bb-c053-4ef8-a255-8e33e0723bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44329bb-c053-4ef8-a255-8e33e0723bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cda9e4-a5ff-4c53-8710-9cb652856552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Volume cce8c9e7-c695-44a3-85b1-d20a0e3b6119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119', 'volume_size': 2}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1343898702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce8c9e7-c695-44a3-85b1-d20a0e3b6119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a283e85eab2422d97c26fb1314239f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:36Z,use_quota=True,user_id='af1ca3f6b63f4623b617239c7f96a8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Creating volume cce8c9e7-c695-44a3-85b1-d20a0e3b6119 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:36 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119 2147483648 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:36 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=112, name=volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119 2147483648" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] <== create_volume: return (175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.177s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.147s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cda9e4-a5ff-4c53-8710-9cb652856552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119', 'volume_size': 2}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fae759a-6f6e-4ab5-88e4-12d7b94db055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[084fea3f-6f8b-4bc0-b3a0-6277e9bf1cf0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Volume volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119 (cce8c9e7-c695-44a3-85b1-d20a0e3b6119): created successfully
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fae759a-6f6e-4ab5-88e4-12d7b94db055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Flow 'volume_create_manager' (ee72804d-ff9f-480b-a176-5be0aef76d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-51ac5b88-dd78-4f3d-aeff-b4db98aad24e tempest-VolumesCloneNegativeTest-2092070787 None] Created volume successfully.
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.153s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-868dccd4-65d5-4852-be26-e9713c6c5e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb3c52b2-8749-4c70-9d62-77b176b5afbf', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:46:36 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-ac141917-3f49-45d2-9c7c-842dc03f0342 req-e6e2728b-b272-407e-826b-cbf5f36fa373 tempest-TestInstancesWithCinderVolumes-1664779642 None] attachment_update completed successfully.
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Acquiring lock "cinder-cce8c9e7-c695-44a3-85b1-d20a0e3b6119-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Lock "cinder-cce8c9e7-c695-44a3-85b1-d20a0e3b6119-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Acquiring lock "cinder-quobyte-cce8c9e7-c695-44a3-85b1-d20a0e3b6119" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Lock "cinder-quobyte-cce8c9e7-c695-44a3-85b1-d20a0e3b6119" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cac1b6-4069-4cd1-a021-085b766cf117]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-cce8c9e7-c695-44a3-85b1-d20a0e3b6119" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Lock "cinder-quobyte-cce8c9e7-c695-44a3-85b1-d20a0e3b6119" released by "delete_volume" :: held 0.193s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Created reservations ['1ab3719c-4ff3-4706-9fee-ec98c786d74d', '5d4a0779-b39b-4c2d-a615-f32c31345ca4', '06a5aa33-2d1a-4e4e-9d62-a4c3484cb446', '779ba1c9-1883-4fbf-982d-afc956907cda'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Deleted volume successfully.
Sep 30 15:46:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80e678b3-193f-4df8-9744-ad9e331c8b7a tempest-VolumesCloneNegativeTest-2092070787 None] Lock "cinder-cce8c9e7-c695-44a3-85b1-d20a0e3b6119-delete_volume" released by "delete_volume" :: held 0.407s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Flow 'volume_create_manager' (8dbae944-288d-466c-a0a1-52fb691b9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcdb7ee-ceac-4f0f-95eb-061578f749e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcdb7ee-ceac-4f0f-95eb-061578f749e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-92387001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73fcea0-5261-4b76-b72f-c439ac6c5484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8a80305a1c493486bdbed62690ecb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:40Z,use_quota=True,user_id='89ba88010dd94888bec41e49b16bba82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd9b06d-910e-4ac6-9704-049154b5930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd9b06d-910e-4ac6-9704-049154b5930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d5bb4d-b118-4214-9827-3ffa4565a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d5bb4d-b118-4214-9827-3ffa4565a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a73fcea0-5261-4b76-b72f-c439ac6c5484', 'volume_name': 'volume-a73fcea0-5261-4b76-b72f-c439ac6c5484', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff42396f190>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5ea0f6-fa51-48c2-a26d-7babea0fea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5ea0f6-fa51-48c2-a26d-7babea0fea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e13fa9c-9954-4f6b-957d-853c0315e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:40 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Volume a73fcea0-5261-4b76-b72f-c439ac6c5484: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a73fcea0-5261-4b76-b72f-c439ac6c5484', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff42396f190>}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Cloning a73fcea0-5261-4b76-b72f-c439ac6c5484 from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31  at location (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:46:40 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027303e-82f0-41bf-9647-952e3b30fb18]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:40 devstack sudo[93510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD
Sep 30 15:46:40 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:46:41 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 is fetched for user 89ba88010dd94888bec41e49b16bba82. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf314e2f-3854-49a2-9af5-97fdf5778504]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:41 devstack sudo[93519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD
Sep 30 15:46:41 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:46:41 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-92387001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73fcea0-5261-4b76-b72f-c439ac6c5484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8a80305a1c493486bdbed62690ecb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:40Z,use_quota=True,user_id='89ba88010dd94888bec41e49b16bba82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Creating volume a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:41 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:41 devstack quobyte-client[80089]: System call "getattr" of process 93528 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:41 devstack quobyte-client[80089]: System call "lookup" of process 93528 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:41 devstack quobyte-client[80089]: System call "getattr" of process 93528 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:42 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=113, name=volume-a73fcea0-5261-4b76-b72f-c439ac6c5484, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 1073741824" returned: 0 in 0.141s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] <== create_volume: return (177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.180s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Attempting download of 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume a73fcea0-5261-4b76-b72f-c439ac6c5484. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[37109e4c-3094-449c-bb5f-1b4535b121d7]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:42 devstack sudo[93533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7
Sep 30 15:46:42 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:46:42 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7" returned: 0 in 0.578s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:42 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:42 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7
Sep 30 15:46:42 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:46:43 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7" returned: 1 in 0.530s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_girt83h7' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4e80ec-da8e-4e68-a3b4-bbf82cd7b545]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:43 devstack sudo[93545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD
Sep 30 15:46:43 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:46:43 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 was qcow2, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:46:43 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:43 devstack sudo[93552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484
Sep 30 15:46:43 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:46:44 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484" returned: 0 in 0.708s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_ogkf18rgdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:46:44 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220b7a8-492c-4f7f-a213-24ef5d8f5c3f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:44 devstack quobyte-client[80089]: System call "open" of process 93575 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 1G" returned: 0 in 0.068s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Downloaded image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume a73fcea0-5261-4b76-b72f-c439ac6c5484 successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 for user 89ba88010dd94888bec41e49b16bba82 is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Marking volume a73fcea0-5261-4b76-b72f-c439ac6c5484 as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Copying metadata from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 to a73fcea0-5261-4b76-b72f-c439ac6c5484. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Creating volume glance metadata for volume a73fcea0-5261-4b76-b72f-c439ac6c5484 backed by image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e13fa9c-9954-4f6b-957d-853c0315e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73fcea0-5261-4b76-b72f-c439ac6c5484', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff42396f190>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a2bf4b-67a9-4475-b600-a206297d5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:44 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Volume volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 (a73fcea0-5261-4b76-b72f-c439ac6c5484): created successfully
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a2bf4b-67a9-4475-b600-a206297d5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Flow 'volume_create_manager' (8dbae944-288d-466c-a0a1-52fb691b9459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-34d8f5aa-0d51-4992-9819-32524e12dada tempest-VolumesExtendTest-28730751 None] Created volume successfully.
Sep 30 15:46:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:45 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[df351b00-f551-4fed-94ab-48030564acb2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 2G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 2G" returned: 0 in 0.079s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:45 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.226s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:46 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-354cd2b2-1842-4210-8e57-7853bbfd2f23 tempest-VolumesExtendTest-28730751 None] Extend volume completed successfully.
Sep 30 15:46:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-a73fcea0-5261-4b76-b72f-c439ac6c5484-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:46 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Lock "cinder-a73fcea0-5261-4b76-b72f-c439ac6c5484-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:47 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-quobyte-a73fcea0-5261-4b76-b72f-c439ac6c5484" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-a73fcea0-5261-4b76-b72f-c439ac6c5484" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d0db25-b589-4ba7-ab90-02ead8ba2ddf]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a73fcea0-5261-4b76-b72f-c439ac6c5484" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-a73fcea0-5261-4b76-b72f-c439ac6c5484" released by "delete_volume" :: held 0.179s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Created reservations ['d623347d-2f46-40b0-ab80-bb02b31434f1', 'e0549a1b-958e-4935-8185-d30916de1a2a', '557e9841-3c04-4fc4-8958-409e65535aff', '600de6e7-812e-4e8d-891a-a89f30d71e12'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:47 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Deleted volume successfully.
Sep 30 15:46:47 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-dd943835-2073-4412-ba69-255675072b39 tempest-VolumesExtendTest-28730751 None] Lock "cinder-a73fcea0-5261-4b76-b72f-c439ac6c5484-delete_volume" released by "delete_volume" :: held 0.334s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:48 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Flow 'volume_create_manager' (b94fec24-e514-43a9-a098-d545e2176a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3c213-e189-421e-8068-6305791f4986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3c213-e189-421e-8068-6305791f4986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1704908384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0513ae7-786d-438a-964e-4226aa178978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8a80305a1c493486bdbed62690ecb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:48Z,use_quota=True,user_id='89ba88010dd94888bec41e49b16bba82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a91ee0-cb09-405f-b77d-ef819ef229f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a91ee0-cb09-405f-b77d-ef819ef229f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fc4465-9af3-42e2-ba3a-6b85bf187724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fc4465-9af3-42e2-ba3a-6b85bf187724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0513ae7-786d-438a-964e-4226aa178978', 'volume_name': 'volume-b0513ae7-786d-438a-964e-4226aa178978', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59a7dca-78bb-41d6-96a6-24fc66a5480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59a7dca-78bb-41d6-96a6-24fc66a5480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38e00d8-80c1-4953-8e0b-16b85626d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:48 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Volume b0513ae7-786d-438a-964e-4226aa178978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0513ae7-786d-438a-964e-4226aa178978', 'volume_size': 1}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1704908384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0513ae7-786d-438a-964e-4226aa178978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8a80305a1c493486bdbed62690ecb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:48Z,use_quota=True,user_id='89ba88010dd94888bec41e49b16bba82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Creating volume b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:48 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:48 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=114, name=volume-b0513ae7-786d-438a-964e-4226aa178978, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 1073741824" returned: 0 in 0.120s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] <== create_volume: return (145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.148s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38e00d8-80c1-4953-8e0b-16b85626d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0513ae7-786d-438a-964e-4226aa178978', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979debc2-b276-4e47-86a8-06bb4c5b134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:48 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Volume volume-b0513ae7-786d-438a-964e-4226aa178978 (b0513ae7-786d-438a-964e-4226aa178978): created successfully
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979debc2-b276-4e47-86a8-06bb4c5b134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:48 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Flow 'volume_create_manager' (b94fec24-e514-43a9-a098-d545e2176a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:48 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-23c44336-fbc0-47fc-ac17-5197f432341f tempest-VolumesExtendTest-28730751 None] Created volume successfully.
Sep 30 15:46:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Creating offline snapshot 778d1a07-fe4e-4a1c-8360-54df76016faa of volume b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b1e9c-4a83-48d9-a0d5-cae0f6e98df8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=115, name=volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa 1G" returned: 0 in 0.091s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b0513ae7-786d-438a-964e-4226aa178978 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "qemu-img rebase -u -b volume-b0513ae7-786d-438a-964e-4226aa178978 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.info" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.info" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.381s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:49 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3095a0da-1f45-4e60-be2b-3c0622e8a39a tempest-VolumesExtendTest-28730751 None] Create snapshot completed successfully
Sep 30 15:46:50 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[61754e03-f4c5-4493-99a7-0e6a0861c4d4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978" returned: 0 in 0.130s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa 2G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa 2G" returned: 0 in 0.066s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.214s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-32ab4d49-1fd0-40f0-89bc-38224ace398e tempest-VolumesExtendTest-28730751 None] Extend volume completed successfully.
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-778d1a07-fe4e-4a1c-8360-54df76016faa-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Lock "cinder-778d1a07-fe4e-4a1c-8360-54df76016faa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:51 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-quobyte-b0513ae7-786d-438a-964e-4226aa178978" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-b0513ae7-786d-438a-964e-4226aa178978" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-quobyte-778d1a07-fe4e-4a1c-8360-54df76016faa" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-778d1a07-fe4e-4a1c-8360-54df76016faa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Deleting offline snapshot 778d1a07-fe4e-4a1c-8360-54df76016faa of volume b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] snapshot_file for this snap is: volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d686e7-cc30-4a16-b5c5-eac28cd0f781]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa" returned: 0 in 0.120s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0513ae7-786d-438a-964e-4226aa178978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[56196e90-7c21-46ee-b77c-c398931297d4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:51 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa" returned: 0 in 0.085s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978.778d1a07-fe4e-4a1c-8360-54df76016faa" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-778d1a07-fe4e-4a1c-8360-54df76016faa" released by "_delete_snapshot" :: held 0.425s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-b0513ae7-786d-438a-964e-4226aa178978" released by "delete_snapshot" :: held 0.437s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Created reservations ['bc7be520-c4ea-4b26-94ff-69c53794e316', '3daf9a55-1677-4166-bcfd-a507b7508bb5', '7c7a0982-dacc-40fc-a2c5-f7a86680a778', 'e71c52f5-397b-4ea9-b333-ad10b7527534'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:52 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Delete snapshot completed successfully.
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d1f14ca7-8348-4284-a112-320ae53ee393 tempest-VolumesExtendTest-28730751 None] Lock "cinder-778d1a07-fe4e-4a1c-8360-54df76016faa-delete_snapshot" released by "delete_snapshot" :: held 0.521s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-b0513ae7-786d-438a-964e-4226aa178978-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Lock "cinder-b0513ae7-786d-438a-964e-4226aa178978-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:52 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Acquiring lock "cinder-quobyte-b0513ae7-786d-438a-964e-4226aa178978" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:52 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-b0513ae7-786d-438a-964e-4226aa178978" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[de668ebd-6347-4d09-aed4-6a4569c3bcb0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978" returned: 0 in 0.137s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-b0513ae7-786d-438a-964e-4226aa178978" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Lock "cinder-quobyte-b0513ae7-786d-438a-964e-4226aa178978" released by "delete_volume" :: held 0.188s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Created reservations ['82ecf519-0074-455a-b9e6-1b87d71183c6', 'a240e1ff-8cca-4ba5-8830-91f00c5c22c4', '1f058690-a82a-48de-b54f-b0056196b0b8', '30db66e2-b0e4-4ef8-873f-d98a2d0f2a18'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:53 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Deleted volume successfully.
Sep 30 15:46:53 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c3d4a089-8d59-4134-a266-8b0a8dd40c74 tempest-VolumesExtendTest-28730751 None] Lock "cinder-b0513ae7-786d-438a-964e-4226aa178978-delete_volume" released by "delete_volume" :: held 0.333s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:55 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (76ad2fe2-d12d-4773-87c3-6922ae90d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23361304-550d-415e-ba93-b0a4ff93ac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23361304-550d-415e-ba93-b0a4ff93ac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140552418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1677492-959e-4787-a63d-5299f39ab1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:56Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3340c8ad-d5a8-4844-83c0-76ec620b2f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3340c8ad-d5a8-4844-83c0-76ec620b2f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4100807f-3b6d-4141-8286-43f94008076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4100807f-3b6d-4141-8286-43f94008076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1677492-959e-4787-a63d-5299f39ab1db', 'volume_name': 'volume-c1677492-959e-4787-a63d-5299f39ab1db', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98e1f5d-f935-4512-aa7b-59ea2848f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98e1f5d-f935-4512-aa7b-59ea2848f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae33c2e-62ef-446e-b51a-71073bf15b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:55 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume c1677492-959e-4787-a63d-5299f39ab1db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1677492-959e-4787-a63d-5299f39ab1db', 'volume_size': 1}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140552418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1677492-959e-4787-a63d-5299f39ab1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:56Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating volume c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:55 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:56 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=117, name=volume-c1677492-959e-4787-a63d-5299f39ab1db, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:56 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-2735e263-49d8-4a17-bc20-41c3ffce0e92 req-c1e263ca-bdb9-43e1-b13b-cf430265dda1 tempest-TestMinimumBasicScenario-12524641 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:56 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-2735e263-49d8-4a17-bc20-41c3ffce0e92 req-c1e263ca-bdb9-43e1-b13b-cf430265dda1 tempest-TestMinimumBasicScenario-12524641 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:56 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-2735e263-49d8-4a17-bc20-41c3ffce0e92 req-c1e263ca-bdb9-43e1-b13b-cf430265dda1 tempest-TestMinimumBasicScenario-12524641 None] Terminate volume connection completed successfully.
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-2735e263-49d8-4a17-bc20-41c3ffce0e92 req-c1e263ca-bdb9-43e1-b13b-cf430265dda1 tempest-TestMinimumBasicScenario-12524641 None] Deleting attachment 1398dfb9-63d6-483f-8694-2c3ea678f209. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db 1073741824" returned: 0 in 0.122s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] <== create_volume: return (153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.155s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae33c2e-62ef-446e-b51a-71073bf15b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1677492-959e-4787-a63d-5299f39ab1db', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acb60a-a24a-4113-ad44-c8d93520196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:56 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume volume-c1677492-959e-4787-a63d-5299f39ab1db (c1677492-959e-4787-a63d-5299f39ab1db): created successfully
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acb60a-a24a-4113-ad44-c8d93520196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (76ad2fe2-d12d-4773-87c3-6922ae90d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:56 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-be2aa0bd-617b-4799-9aee-921cca9626dd tempest-CreateVolumesFromSnapshotTest-519819786 None] Created volume successfully.
Sep 30 15:46:57 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating offline snapshot 955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb of volume c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c7f2d3-5b23-4342-9b3a-41ee9554cb8b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db" returned: 0 in 0.151s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=118, name=volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb 1G" returned: 0 in 0.104s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c1677492-959e-4787-a63d-5299f39ab1db -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img rebase -u -b volume-c1677492-959e-4787-a63d-5299f39ab1db -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.info" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.info" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:57 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.412s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:57 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-47d3254b-5082-477a-ba2b-a9d971760163 tempest-CreateVolumesFromSnapshotTest-519819786 None] Create snapshot completed successfully
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Acquiring lock "cinder-677a19a0-aaa1-4461-8edd-482d603a28c1-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Lock "cinder-677a19a0-aaa1-4461-8edd-482d603a28c1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Acquiring lock "cinder-quobyte-677a19a0-aaa1-4461-8edd-482d603a28c1" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Lock "cinder-quobyte-677a19a0-aaa1-4461-8edd-482d603a28c1" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d920f-9939-49be-b56a-96e53d87a240]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-677a19a0-aaa1-4461-8edd-482d603a28c1" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Lock "cinder-quobyte-677a19a0-aaa1-4461-8edd-482d603a28c1" released by "delete_volume" :: held 0.203s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Created reservations ['32789a4a-a820-4403-819c-6c67d4804f16', '522cfcf7-2d1d-43f2-bde8-950d4e193504', '351e2c89-df71-4113-aa0d-28ae17deae3e', '3346124c-ab86-4905-9131-c6bcca44a7fa'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:46:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (1c00f5e1-453e-4fc3-bbea-2f7cf6dd5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c64dcf-3123-4758-8ba9-4f5db802be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Deleted volume successfully.
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c64dcf-3123-4758-8ba9-4f5db802be33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174595127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3531573-23d6-42fb-af59-ca6eccbbb9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:58Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0ed949-3626-4c88-9933-58f8edeecc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0ed949-3626-4c88-9933-58f8edeecc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bde8167-0f26-458a-864a-ebd24970956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bde8167-0f26-458a-864a-ebd24970956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3531573-23d6-42fb-af59-ca6eccbbb9ed', 'volume_name': 'volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90699733-a6cc-4ced-b24b-16435764dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90699733-a6cc-4ced-b24b-16435764dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95b3360-e3d4-45df-b6ab-3b8799c56cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume d3531573-23d6-42fb-af59-ca6eccbbb9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed', 'volume_size': 1}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174595127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3531573-23d6-42fb-af59-ca6eccbbb9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:58Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating volume d3531573-23d6-42fb-af59-ca6eccbbb9ed {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ccd9042-8886-484a-b140-face5c2d625e tempest-TestMinimumBasicScenario-12524641 None] Lock "cinder-677a19a0-aaa1-4461-8edd-482d603a28c1-delete_volume" released by "delete_volume" :: held 0.488s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:46:58 devstack quobyte-client[80089]: System call "open" of process 93675 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:58 devstack quobyte-client[80089]: System call "ioctl" of process 93675 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:58 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=120, name=volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:58 devstack quobyte-client[80089]: System call "open" of process 93675 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:46:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (99fb0c6a-f1a9-4bca-afbd-338e9cad0921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b95273-a1d4-4577-9998-3e6efb75c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b95273-a1d4-4577-9998-3e6efb75c867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075577098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4f0358-09be-4bc6-820c-493a2f9b61c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2f1762-0997-421a-a02d-8feb16201c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2f1762-0997-421a-a02d-8feb16201c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc956743-e355-4eb7-97d4-e9f7884588c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc956743-e355-4eb7-97d4-e9f7884588c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4f0358-09be-4bc6-820c-493a2f9b61c0', 'volume_name': 'volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cf702f-5fa6-4224-86db-c5406d44e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cf702f-5fa6-4224-86db-c5406d44e81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64ae2a-8721-444c-aa19-233faa9386a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume 3b4f0358-09be-4bc6-820c-493a2f9b61c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0', 'volume_size': 1}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed 1073741824" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] <== create_volume: return (176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.178s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075577098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4f0358-09be-4bc6-820c-493a2f9b61c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating volume 3b4f0358-09be-4bc6-820c-493a2f9b61c0 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95b3360-e3d4-45df-b6ab-3b8799c56cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9543275d-6795-48ff-89bf-556e82c2a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed (d3531573-23d6-42fb-af59-ca6eccbbb9ed): created successfully
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9543275d-6795-48ff-89bf-556e82c2a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=121, name=volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (1c00f5e1-453e-4fc3-bbea-2f7cf6dd5c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bf726b7f-d792-4fb1-bbca-0708c5b967aa tempest-CreateVolumesFromSnapshotTest-519819786 None] Created volume successfully.
Sep 30 15:46:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (1c09d78b-9e3d-47ff-95da-fb7c759804ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b5f64c-1ea9-47e5-a8bd-0c39e3992060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0 1073741824" returned: 0 in 0.138s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b5f64c-1ea9-47e5-a8bd-0c39e3992060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712768535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862744f7-106e-430d-8f15-5d1e380df62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78d1755-ac23-4116-8d62-361f643dcf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78d1755-ac23-4116-8d62-361f643dcf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dab256-5dfc-463f-887b-d198dd03668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dab256-5dfc-463f-887b-d198dd03668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862744f7-106e-430d-8f15-5d1e380df62b', 'volume_name': 'volume-862744f7-106e-430d-8f15-5d1e380df62b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47b7a54-5167-4081-9208-9fdd4aaea21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47b7a54-5167-4081-9208-9fdd4aaea21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaca03d9-72d9-4dd8-a7c5-4e3a9076fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume 862744f7-106e-430d-8f15-5d1e380df62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862744f7-106e-430d-8f15-5d1e380df62b', 'volume_size': 1}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0" returned: 0 in 0.052s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] <== create_volume: return (196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.199s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712768535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862744f7-106e-430d-8f15-5d1e380df62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating volume 862744f7-106e-430d-8f15-5d1e380df62b {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64ae2a-8721-444c-aa19-233faa9386a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab421ffb-7b54-41dc-9fad-73e2f743f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0 (3b4f0358-09be-4bc6-820c-493a2f9b61c0): created successfully
Sep 30 15:46:58 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=122, name=volume-862744f7-106e-430d-8f15-5d1e380df62b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab421ffb-7b54-41dc-9fad-73e2f743f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (99fb0c6a-f1a9-4bca-afbd-338e9cad0921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f7dd16f1-d64d-4b7f-867e-f6c5e5dfbdf5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created volume successfully.
Sep 30 15:46:58 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (5bfda7d3-bfc9-487d-9d71-c564ff2afec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca57784-57ff-4c06-84e0-c4a487c8a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b 1073741824" returned: 0 in 0.122s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca57784-57ff-4c06-84e0-c4a487c8a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111130620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e59ed4-f841-4192-961e-5384d11ee809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28d6133-8ef3-452c-9ae1-516d51205522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28d6133-8ef3-452c-9ae1-516d51205522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d26670-5ba5-4cd6-911f-fcba3797d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d26670-5ba5-4cd6-911f-fcba3797d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e59ed4-f841-4192-961e-5384d11ee809', 'volume_name': 'volume-f7e59ed4-f841-4192-961e-5384d11ee809', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11248829-6198-4fd1-a53a-960e6e92b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11248829-6198-4fd1-a53a-960e6e92b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c686ec-b5f1-4d68-ac07-3eda04dd73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume f7e59ed4-f841-4192-961e-5384d11ee809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e59ed4-f841-4192-961e-5384d11ee809', 'volume_size': 1}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b" returned: 0 in 0.051s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.184s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111130620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e59ed4-f841-4192-961e-5384d11ee809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating volume f7e59ed4-f841-4192-961e-5384d11ee809 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaca03d9-72d9-4dd8-a7c5-4e3a9076fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862744f7-106e-430d-8f15-5d1e380df62b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf63388-c73a-4b4a-b6ad-a714ee12a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume volume-862744f7-106e-430d-8f15-5d1e380df62b (862744f7-106e-430d-8f15-5d1e380df62b): created successfully
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf63388-c73a-4b4a-b6ad-a714ee12a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (1c09d78b-9e3d-47ff-95da-fb7c759804ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6a8131ad-fb14-41a2-b193-ce8202a7d30a tempest-CreateVolumesFromSnapshotTest-519819786 None] Created volume successfully.
Sep 30 15:46:59 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=123, name=volume-f7e59ed4-f841-4192-961e-5384d11ee809, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (66236537-9dd6-4a39-a30a-f8df9bcb40f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812e6985-1d2a-4176-b871-36a9b56891e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812e6985-1d2a-4176-b871-36a9b56891e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770492385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef074d02-7929-4209-9a72-d993f3d2d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef074d02-7929-4209-9a72-d993f3d2d59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdba3ec-fc3e-40c9-801b-da2ca29a1c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdba3ec-fc3e-40c9-801b-da2ca29a1c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21', 'volume_name': 'volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a969aec-9e63-4839-93cc-4df728afd010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a969aec-9e63-4839-93cc-4df728afd010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea817a9-016b-4fa2-9347-218fb93cece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume 0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21', 'volume_size': 1}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809 1073741824" returned: 0 in 0.210s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] <== create_volume: return (236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.238s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770492385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fb0adc477a41478f8d6af8f5bf170e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:46:59Z,use_quota=True,user_id='5340218a39fa4ba8986cc0580061e5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Creating volume 0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c686ec-b5f1-4d68-ac07-3eda04dd73b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e59ed4-f841-4192-961e-5384d11ee809', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fbfde8-7ac0-4cc0-bc98-98483286eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=124, name=volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume volume-f7e59ed4-f841-4192-961e-5384d11ee809 (f7e59ed4-f841-4192-961e-5384d11ee809): created successfully
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fbfde8-7ac0-4cc0-bc98-98483286eba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (5bfda7d3-bfc9-487d-9d71-c564ff2afec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ead4a06e-3a91-48d0-9427-ad53c4fee1f7 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created volume successfully.
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 1073741824" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] <== create_volume: return (156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.159s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea817a9-016b-4fa2-9347-218fb93cece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d766dae-f84c-4b76-9753-e2fe83ab4e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 (0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21): created successfully
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d766dae-f84c-4b76-9753-e2fe83ab4e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:46:59 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Flow 'volume_create_manager' (66236537-9dd6-4a39-a30a-f8df9bcb40f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:46:59 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0d5ea405-e246-40fc-806b-4dab26f8255d tempest-CreateVolumesFromSnapshotTest-519819786 None] Created volume successfully.
Sep 30 15:46:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[15723202-5634-4a3a-aaad-8dcead0e57b7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:00 devstack quobyte-client[80089]: System call "getattr" of process 93719 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:00 devstack quobyte-client[80089]: System call "open" of process 93719 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21" returned: 0 in 0.157s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21" returned: 0 in 0.055s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21" released by "delete_volume" :: held 0.267s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['a555fadc-0a0f-44dc-9f9f-c7f98bb571ec', '73fb392c-55fd-46c9-9ba2-69c124d5a6c2', 'c674def9-9b48-4462-a10e-e47e20fc299e', 'dec9ad63-7b2e-4f31-a00d-677a3a2f17ab'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleted volume successfully.
Sep 30 15:47:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-afff30e9-e7d9-4230-b826-30f63269bbe5 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-0e6f444d-b0dd-4869-bfd9-dc8ce11d6c21-delete_volume" released by "delete_volume" :: held 0.442s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-f7e59ed4-f841-4192-961e-5384d11ee809-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-f7e59ed4-f841-4192-961e-5384d11ee809-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=126,cinder:UPDATE=137,cinder:DELETE=14,cinder:INSERT=43 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=174,cinder:DELETE=17,cinder:SELECT=121,cinder:INSERT=30 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:47:01 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-f7e59ed4-f841-4192-961e-5384d11ee809" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-f7e59ed4-f841-4192-961e-5384d11ee809" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[51187cd1-e067-4f46-bb6f-6e73e78c723c]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:01 devstack quobyte-client[80089]: System call "statfs" of process 93743 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-f7e59ed4-f841-4192-961e-5384d11ee809" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-f7e59ed4-f841-4192-961e-5384d11ee809" released by "delete_volume" :: held 0.209s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['a2baf9cc-3bc4-403c-a227-567e7823425d', 'a0fae676-fb90-4556-9ec4-806fe69c5042', '11f4d2b3-9604-49cc-999b-5cf5e5e8e24f', '7a1a22d1-9835-4da8-b2e5-3ecb1de4f803'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:01 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:01 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleted volume successfully.
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-73758f6b-8bc2-4bcb-a8fc-c659ef89ad25 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-f7e59ed4-f841-4192-961e-5384d11ee809-delete_volume" released by "delete_volume" :: held 0.368s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-862744f7-106e-430d-8f15-5d1e380df62b-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-862744f7-106e-430d-8f15-5d1e380df62b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-862744f7-106e-430d-8f15-5d1e380df62b" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-862744f7-106e-430d-8f15-5d1e380df62b" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eb713f-b075-40ad-beb1-912f218869e3]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-862744f7-106e-430d-8f15-5d1e380df62b" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-862744f7-106e-430d-8f15-5d1e380df62b" released by "delete_volume" :: held 0.192s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['2934bb45-38d4-4a65-b59f-e56a75ef65ac', 'f51290a7-1467-4dd8-abcc-d014d70acdc7', '36e80196-1f96-4264-85ac-1603316ffca1', '66abf70b-02be-4cb9-8f59-b08b58839125'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:03 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleted volume successfully.
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-27a537f2-00bf-4fc6-abd7-13e68e31ee30 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-862744f7-106e-430d-8f15-5d1e380df62b-delete_volume" released by "delete_volume" :: held 0.326s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-3b4f0358-09be-4bc6-820c-493a2f9b61c0-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-3b4f0358-09be-4bc6-820c-493a2f9b61c0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:03 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-3b4f0358-09be-4bc6-820c-493a2f9b61c0" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-3b4f0358-09be-4bc6-820c-493a2f9b61c0" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ae97c-db53-418a-9ab5-1c9765b33b33]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:03 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:04 devstack quobyte-client[80089]: System call "getattr" of process 93755 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3b4f0358-09be-4bc6-820c-493a2f9b61c0" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-3b4f0358-09be-4bc6-820c-493a2f9b61c0" released by "delete_volume" :: held 0.190s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['549ba75d-9a9f-4f92-9c0a-19ae7d5a5b54', '42ad4fa8-3881-4c0f-87a5-eac496ac22fe', '2248b421-0d6e-418e-ae79-31baa25fc0f3', 'c9f48ff2-2f07-469c-afc1-211016a8643d'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleted volume successfully.
Sep 30 15:47:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-133bff33-e8d5-42cd-a9f9-3c3ad59aa6a2 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-3b4f0358-09be-4bc6-820c-493a2f9b61c0-delete_volume" released by "delete_volume" :: held 0.350s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-d3531573-23d6-42fb-af59-ca6eccbbb9ed-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-d3531573-23d6-42fb-af59-ca6eccbbb9ed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:05 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-d3531573-23d6-42fb-af59-ca6eccbbb9ed" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-d3531573-23d6-42fb-af59-ca6eccbbb9ed" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15632c5-d417-401a-a060-12296991c4c9]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed" returned: 0 in 0.154s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d3531573-23d6-42fb-af59-ca6eccbbb9ed" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-d3531573-23d6-42fb-af59-ca6eccbbb9ed" released by "delete_volume" :: held 0.197s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['fbd83551-1416-4c34-9842-65ed2f1f2da5', 'ad10ec09-20d9-460f-9c6e-6188bb0d2902', 'd3e766df-607b-4535-9a89-0183a9456b1b', '9bc5eb42-6c0f-40c8-9b9d-1f67eb27d1c5'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:05 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleted volume successfully.
Sep 30 15:47:05 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9f29b7e7-79ea-49a7-a479-8d612af8219d tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-d3531573-23d6-42fb-af59-ca6eccbbb9ed-delete_volume" released by "delete_volume" :: held 0.349s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:06 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-c1677492-959e-4787-a63d-5299f39ab1db" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-c1677492-959e-4787-a63d-5299f39ab1db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleting offline snapshot 955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb of volume c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] snapshot_file for this snap is: volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb7a32-08e6-4cd6-bfbf-38a847105d9b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1677492-959e-4787-a63d-5299f39ab1db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8715e5ca-b9a8-42b3-b1bc-bc897688f419]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db" returned: 0 in 0.146s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" returned: 0 in 0.080s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db.955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb" released by "_delete_snapshot" :: held 0.462s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-c1677492-959e-4787-a63d-5299f39ab1db" released by "delete_snapshot" :: held 0.474s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['0975ee5e-e5c2-4db5-babb-b081fb5393ca', '8344dc90-b040-49f0-af35-f96249ccbeea', 'ea805132-b920-4255-957f-edad25de0717', '6756b5b4-4bab-4364-936a-8cd279610aec'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:06 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Delete snapshot completed successfully.
Sep 30 15:47:06 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b23d843-b50c-4130-918d-3817cf05e618 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-955d7c9c-17e3-4aa9-9ac5-417e2a5ff7fb-delete_snapshot" released by "delete_snapshot" :: held 0.571s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-c1677492-959e-4787-a63d-5299f39ab1db-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-c1677492-959e-4787-a63d-5299f39ab1db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:07 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "cinder-quobyte-c1677492-959e-4787-a63d-5299f39ab1db" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-c1677492-959e-4787-a63d-5299f39ab1db" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2644d276-d1ca-472a-a283-533b1057beab]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c1677492-959e-4787-a63d-5299f39ab1db" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-quobyte-c1677492-959e-4787-a63d-5299f39ab1db" released by "delete_volume" :: held 0.203s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Created reservations ['2f0dafae-a539-479f-bffe-39d23a0b76f2', '696c9912-21dd-41ff-a5b9-575cddccf6b9', '24f4e515-00ad-4d7e-a288-65ccb1a26630', '8df2764e-2fe2-4be4-86f9-68a5c9137860'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:07 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Deleted volume successfully.
Sep 30 15:47:07 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-02202d7e-43a7-4765-a93e-ecd3f91a5575 tempest-CreateVolumesFromSnapshotTest-519819786 None] Lock "cinder-c1677492-959e-4787-a63d-5299f39ab1db-delete_volume" released by "delete_volume" :: held 0.392s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-ae5de825-aa99-4146-9869-7077a40deda5 req-3565e00a-ff29-405b-87fd-803ccd027798 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-ae5de825-aa99-4146-9869-7077a40deda5 req-3565e00a-ff29-405b-87fd-803ccd027798 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-ae5de825-aa99-4146-9869-7077a40deda5 req-3565e00a-ff29-405b-87fd-803ccd027798 tempest-TestInstancesWithCinderVolumes-1664779642 None] Terminate volume connection completed successfully.
Sep 30 15:47:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-ae5de825-aa99-4146-9869-7077a40deda5 req-3565e00a-ff29-405b-87fd-803ccd027798 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deleting attachment 457e8a99-9739-4e09-803b-46a159e06b0c. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:47:10 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Flow 'volume_create_manager' (60739601-d921-4741-a24a-b2c19af2c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c57310-6d93-4ff8-8f7e-5173c5e2abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c57310-6d93-4ff8-8f7e-5173c5e2abcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac496be-a922-4698-90ee-aa1e69270e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d5a9cbe7944e819ba9ca5507554588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:47:10Z,use_quota=True,user_id='237656d68ba44f439fe99e69938c8a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95658da2-fec3-4bba-8991-357f9b9648ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95658da2-fec3-4bba-8991-357f9b9648ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291b2e1e-a6a2-4ccf-ba9a-26e89695a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291b2e1e-a6a2-4ccf-ba9a-26e89695a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac496be-a922-4698-90ee-aa1e69270e25', 'volume_name': 'volume-8ac496be-a922-4698-90ee-aa1e69270e25', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3822a7cd-b1d3-4479-a5e5-aacbb44b113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3822a7cd-b1d3-4479-a5e5-aacbb44b113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd9c488-e045-4c27-8eb2-2f42739be401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:10 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Volume 8ac496be-a922-4698-90ee-aa1e69270e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac496be-a922-4698-90ee-aa1e69270e25', 'volume_size': 1}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac496be-a922-4698-90ee-aa1e69270e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d5a9cbe7944e819ba9ca5507554588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:47:10Z,use_quota=True,user_id='237656d68ba44f439fe99e69938c8a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Creating volume 8ac496be-a922-4698-90ee-aa1e69270e25 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:47:10 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:10 devstack quobyte-client[80089]: System call "ioctl" of process 93784 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:10 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=125, name=volume-8ac496be-a922-4698-90ee-aa1e69270e25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25 1073741824" returned: 0 in 0.118s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] <== create_volume: return (144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.146s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd9c488-e045-4c27-8eb2-2f42739be401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac496be-a922-4698-90ee-aa1e69270e25', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4bdada-f2c4-4cd4-8a0e-6c2b96923424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:10 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Volume volume-8ac496be-a922-4698-90ee-aa1e69270e25 (8ac496be-a922-4698-90ee-aa1e69270e25): created successfully
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4bdada-f2c4-4cd4-8a0e-6c2b96923424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:10 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Flow 'volume_create_manager' (60739601-d921-4741-a24a-b2c19af2c37a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:47:10 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d799c2b9-d294-490f-bbc2-3968c34f9822 tempest-CinderUnicodeTest-652623645 None] Created volume successfully.
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "cinder-7367f07f-d27d-4538-a179-d094484cb623-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-7367f07f-d27d-4538-a179-d094484cb623-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:11 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "cinder-quobyte-7367f07f-d27d-4538-a179-d094484cb623" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-quobyte-7367f07f-d27d-4538-a179-d094484cb623" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[19207e26-7eee-437c-8216-a40a1d1a4652]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:11 devstack quobyte-client[80089]: System call "open" of process 93822 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623" returned: 0 in 0.292s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7367f07f-d27d-4538-a179-d094484cb623" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-quobyte-7367f07f-d27d-4538-a179-d094484cb623" released by "delete_volume" :: held 0.360s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:11 devstack cinder-volume[80302]: WARNING cinder.quota [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-709328685-1399748280 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-709328685-1399748280, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:47:11 devstack cinder-volume[80302]: WARNING cinder.quota [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-709328685-1399748280 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-709328685-1399748280, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Created reservations ['07f8eca9-fec1-4935-8f71-257179ad2178', '8df58ede-73db-4242-8694-8b793da17c9d', '4de4a33a-128b-4b64-9b51-63eeee4a3035', '69b6ce7e-6cd8-4ad5-96ee-0188cc265159'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:11 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deleted volume successfully.
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2e31f5fb-68ea-4b90-b143-ae64aad13ff7 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-7367f07f-d27d-4538-a179-d094484cb623-delete_volume" released by "delete_volume" :: held 0.557s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:11 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Flow 'volume_create_manager' (0c34758c-c3d7-4ad8-9adb-6320bcf4076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b5215-3ea2-4909-a901-9e5b0a960e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b5215-3ea2-4909-a901-9e5b0a960e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:47:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-117978364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3030d542-5689-42ba-959a-6b3db711013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d5a9cbe7944e819ba9ca5507554588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:47:12Z,use_quota=True,user_id='237656d68ba44f439fe99e69938c8a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1ddafd-4c19-46e1-bfbf-2b29fc83d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1ddafd-4c19-46e1-bfbf-2b29fc83d706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:11 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a78a2a0-9fc9-449f-9586-c67753b524b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a78a2a0-9fc9-449f-9586-c67753b524b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3030d542-5689-42ba-959a-6b3db711013a', 'volume_name': 'volume-3030d542-5689-42ba-959a-6b3db711013a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe447ca-c63f-4d6d-9feb-bdf50b2b3a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe447ca-c63f-4d6d-9feb-bdf50b2b3a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9a87b-50d6-4d74-be5d-2892896e1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:12 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Volume 3030d542-5689-42ba-959a-6b3db711013a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3030d542-5689-42ba-959a-6b3db711013a', 'volume_size': 1}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:47:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-117978364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3030d542-5689-42ba-959a-6b3db711013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d5a9cbe7944e819ba9ca5507554588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:47:12Z,use_quota=True,user_id='237656d68ba44f439fe99e69938c8a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Creating volume 3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:47:12 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:12 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=126, name=volume-3030d542-5689-42ba-959a-6b3db711013a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a 1073741824" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] <== create_volume: return (190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.194s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9a87b-50d6-4d74-be5d-2892896e1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3030d542-5689-42ba-959a-6b3db711013a', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c56c1e-a45d-4fb7-966c-6a368d749bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:12 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Volume volume-3030d542-5689-42ba-959a-6b3db711013a (3030d542-5689-42ba-959a-6b3db711013a): created successfully
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c56c1e-a45d-4fb7-966c-6a368d749bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:12 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Flow 'volume_create_manager' (0c34758c-c3d7-4ad8-9adb-6320bcf4076a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:47:12 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-fe94ddd0-66d6-4c49-83ff-a6a91d36aa06 tempest-CinderUnicodeTest-652623645 None] Created volume successfully.
Sep 30 15:47:13 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Creating offline snapshot db4af053-4349-49e5-b3e2-97552c009560 of volume 3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[502e2008-4f2a-4422-89db-8bdde0bc15b7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack quobyte-client[80089]: System call "open" of process 93845 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a" returned: 0 in 0.169s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=127, name=volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 1G" returned: 0 in 0.120s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3030d542-5689-42ba-959a-6b3db711013a -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "qemu-img rebase -u -b volume-3030d542-5689-42ba-959a-6b3db711013a -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560" returned: 0 in 0.050s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.info" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.info" returned: 0 in 0.033s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:13 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.553s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:13 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-594367f0-a08d-47bb-826c-63186bbfd0ac tempest-CinderUnicodeTest-652623645 None] Create snapshot completed successfully
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-db4af053-4349-49e5-b3e2-97552c009560-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Lock "cinder-db4af053-4349-49e5-b3e2-97552c009560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:14 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-quobyte-3030d542-5689-42ba-959a-6b3db711013a" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-3030d542-5689-42ba-959a-6b3db711013a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-quobyte-db4af053-4349-49e5-b3e2-97552c009560" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-db4af053-4349-49e5-b3e2-97552c009560" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Deleting offline snapshot db4af053-4349-49e5-b3e2-97552c009560 of volume 3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] snapshot_file for this snap is: volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f139e-2ed0-48f6-92bb-38eb4271ad39]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:14 devstack quobyte-client[80089]: System call "open" of process 93862 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3030d542-5689-42ba-959a-6b3db711013a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[63692496-d3c9-41e8-b118-043ce16a7a78]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a" returned: 0 in 0.184s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:14 devstack quobyte-client[80089]: System call "lookup" of process 93871 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:14 devstack quobyte-client[80089]: System call "getattr" of process 93871 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:14 devstack quobyte-client[80089]: System call "open" of process 93871 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560" returned: 0 in 0.088s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a.db4af053-4349-49e5-b3e2-97552c009560" returned: 0 in 0.052s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-db4af053-4349-49e5-b3e2-97552c009560" released by "_delete_snapshot" :: held 0.599s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-3030d542-5689-42ba-959a-6b3db711013a" released by "delete_snapshot" :: held 0.623s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Created reservations ['0459dbe3-4ec1-49ff-a6ce-da30ae66b130', '69a93d3a-fcd4-496d-b0c7-186242e40495', 'a2ca3d5a-9540-42bf-997f-ed2f176c4c85', 'dad91b74-aa13-41b1-b0c8-881b9f526ad0'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:14 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Delete snapshot completed successfully.
Sep 30 15:47:14 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-37f4c72f-adff-4a42-ae8d-f05624c89356 tempest-CinderUnicodeTest-652623645 None] Lock "cinder-db4af053-4349-49e5-b3e2-97552c009560-delete_snapshot" released by "delete_snapshot" :: held 0.737s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-3030d542-5689-42ba-959a-6b3db711013a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Lock "cinder-3030d542-5689-42ba-959a-6b3db711013a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-quobyte-3030d542-5689-42ba-959a-6b3db711013a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-3030d542-5689-42ba-959a-6b3db711013a" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f287baef-d59a-4c18-889f-5dcfd9bfe693]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a" returned: 0 in 0.157s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-3030d542-5689-42ba-959a-6b3db711013a" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-3030d542-5689-42ba-959a-6b3db711013a" released by "delete_volume" :: held 0.243s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Created reservations ['c0401e76-cbda-4b75-ae4a-fe1a89e62215', 'da181a18-d2a0-4470-812a-63342e4cbf81', 'e5fde96f-7031-462c-bcff-5fc0ee766286', '1a7a8001-5c6c-4812-bca0-d0311a8fbe81'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:15 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Deleted volume successfully.
Sep 30 15:47:15 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-3826e661-7ba2-4196-ac18-788babd89c8c tempest-CinderUnicodeTest-652623645 None] Lock "cinder-3030d542-5689-42ba-959a-6b3db711013a-delete_volume" released by "delete_volume" :: held 0.439s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-8ac496be-a922-4698-90ee-aa1e69270e25-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Lock "cinder-8ac496be-a922-4698-90ee-aa1e69270e25-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Acquiring lock "cinder-quobyte-8ac496be-a922-4698-90ee-aa1e69270e25" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-8ac496be-a922-4698-90ee-aa1e69270e25" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c25643-6156-415a-9dc4-7fc8c0d12768]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-8ac496be-a922-4698-90ee-aa1e69270e25" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Lock "cinder-quobyte-8ac496be-a922-4698-90ee-aa1e69270e25" released by "delete_volume" :: held 0.205s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Created reservations ['26b1df65-90c7-4d19-84bb-bf7df0118bfc', 'bcea14a2-f719-4547-b003-c1c848340633', '7e0e5bc9-5d34-480e-9cd9-b8cac472839b', '88570bb3-b0e0-4329-8cdd-51bb96a81e63'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Deleted volume successfully.
Sep 30 15:47:16 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0da33ea0-6c76-4d15-8506-66e0f951ba1d tempest-CinderUnicodeTest-652623645 None] Lock "cinder-8ac496be-a922-4698-90ee-aa1e69270e25-delete_volume" released by "delete_volume" :: held 0.360s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:26 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=58,cinder:INSERT=26,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:47:26 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=48,cinder:INSERT=14,cinder:UPDATE=79,cinder:DELETE=5 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:47:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Flow 'volume_create_manager' (299a1ef1-c6ca-43ea-84fe-c0f9a408e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691137b6-83f9-42ed-a79e-c347dc3fbf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691137b6-83f9-42ed-a79e-c347dc3fbf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-208541008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48677e59-0d26-4c8a-8fb5-fc863d012dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e43700e08c4170bc1c43c64d8e15cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:47:32Z,use_quota=True,user_id='e9251aa076d34293a853eeef713c6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b0ee7b-5e92-424c-9c92-5bf0dddfb9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b0ee7b-5e92-424c-9c92-5bf0dddfb9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4ebcc4-eca6-45aa-8437-97c436e72e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4ebcc4-eca6-45aa-8437-97c436e72e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48677e59-0d26-4c8a-8fb5-fc863d012dd4', 'volume_name': 'volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4194ed720>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a1264-40da-42ca-ae47-283d94f049e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a1264-40da-42ca-ae47-283d94f049e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551f6ffa-879c-44c6-bb7e-10430ccfef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:32 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Volume 48677e59-0d26-4c8a-8fb5-fc863d012dd4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4194ed720>}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Cloning 48677e59-0d26-4c8a-8fb5-fc863d012dd4 from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31  at location (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:47:32 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6a6a03-8246-4b9d-9085-abaa6ce7b848]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:32 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD
Sep 30 15:47:32 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:47:33 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 is fetched for user e9251aa076d34293a853eeef713c6a90. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8852bbd-460d-4614-8b56-5c80d70dd873]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:33 devstack sudo[93912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD
Sep 30 15:47:33 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:47:33 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD" returned: 0 in 0.530s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-208541008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48677e59-0d26-4c8a-8fb5-fc863d012dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e43700e08c4170bc1c43c64d8e15cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:47:32Z,use_quota=True,user_id='e9251aa076d34293a853eeef713c6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Creating volume 48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:47:33 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:33 devstack quobyte-client[80089]: System call "ioctl" of process 93917 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:33 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=129, name=volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 1073741824" returned: 0 in 0.108s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] <== create_volume: return (133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.136s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Attempting download of 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume 48677e59-0d26-4c8a-8fb5-fc863d012dd4. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ebc023-ff96-4e11-ab86-866ad267ee09]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:34 devstack sudo[93921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72
Sep 30 15:47:34 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:47:34 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root
Sep 30 15:47:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72" returned: 0 in 0.525s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:34 devstack sudo[93925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72
Sep 30 15:47:34 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:47:35 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72" returned: 1 in 0.560s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_q33t_w72' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c695f-8cd7-4775-9f98-8afc35e7d0df]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:35 devstack sudo[93929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD
Sep 30 15:47:35 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:47:35 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 was qcow2, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:47:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:35 devstack sudo[93934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4
Sep 30 15:47:35 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:47:36 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.698s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27fcc2fe-02d8-4c65-97b1-082d7bad7e31_isyosrn0devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:47:36 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe7096-4767-487b-a76b-26a292af43b9]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 1G" returned: 0 in 0.073s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Downloaded image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 ((None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}])) to volume 48677e59-0d26-4c8a-8fb5-fc863d012dd4 successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Temporary image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 for user e9251aa076d34293a853eeef713c6a90 is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Marking volume 48677e59-0d26-4c8a-8fb5-fc863d012dd4 as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Copying metadata from image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 to 48677e59-0d26-4c8a-8fb5-fc863d012dd4. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Creating volume glance metadata for volume 48677e59-0d26-4c8a-8fb5-fc863d012dd4 backed by image 27fcc2fe-02d8-4c65-97b1-082d7bad7e31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551f6ffa-879c-44c6-bb7e-10430ccfef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4', 'volume_size': 1, 'image_id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b33a306722f4f3f9e84f98575a26ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '27fcc2fe-02d8-4c65-97b1-082d7bad7e31', 'created_at': datetime.datetime(2025, 9, 30, 13, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 26, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27fcc2fe-02d8-4c65-97b1-082d7bad7e31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4194ed720>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ec1699-6c0e-4259-ab23-dc157e44ed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:47:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Volume volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 (48677e59-0d26-4c8a-8fb5-fc863d012dd4): created successfully
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ec1699-6c0e-4259-ab23-dc157e44ed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:47:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Flow 'volume_create_manager' (299a1ef1-c6ca-43ea-84fe-c0f9a408e81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:47:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4a2e49b6-b566-4c30-8c8c-318ff6a080bc tempest-TestShelveInstance-1778332493 None] Created volume successfully.
Sep 30 15:47:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-e4beb1b3-148a-4587-b1ab-3e49c0d4d61c req-a20271e6-c3fb-4317-9c2f-67664d330801 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-e4beb1b3-148a-4587-b1ab-3e49c0d4d61c req-a20271e6-c3fb-4317-9c2f-67664d330801 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-e4beb1b3-148a-4587-b1ab-3e49c0d4d61c req-a20271e6-c3fb-4317-9c2f-67664d330801 tempest-TestInstancesWithCinderVolumes-1664779642 None] Terminate volume connection completed successfully.
Sep 30 15:47:38 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-e4beb1b3-148a-4587-b1ab-3e49c0d4d61c req-a20271e6-c3fb-4317-9c2f-67664d330801 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deleting attachment bb3c52b2-8749-4c70-9d62-77b176b5afbf. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "cinder-868dccd4-65d5-4852-be26-e9713c6c5e91-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-868dccd4-65d5-4852-be26-e9713c6c5e91-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:40 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "cinder-quobyte-868dccd4-65d5-4852-be26-e9713c6c5e91" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-quobyte-868dccd4-65d5-4852-be26-e9713c6c5e91" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:40 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2878993-cfa8-442d-a240-1987dc416f2e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91" returned: 0 in 0.156s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-868dccd4-65d5-4852-be26-e9713c6c5e91" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-quobyte-868dccd4-65d5-4852-be26-e9713c6c5e91" released by "delete_volume" :: held 0.201s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:41 devstack cinder-volume[80302]: WARNING cinder.quota [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238947964-656677106 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238947964-656677106, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:47:41 devstack cinder-volume[80302]: WARNING cinder.quota [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238947964-656677106 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1238947964-656677106, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Created reservations ['ffa91069-03c9-4e62-8e35-ed53e264de67', '21ebbe9d-26c4-4e45-b221-c251d231a565', '6dedd4f1-a694-463d-bc85-998e9a9657f6', '62075627-48db-4eb2-a23d-a9d39571f582'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:41 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Deleted volume successfully.
Sep 30 15:47:41 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-c497f189-e48e-4a86-b4f3-61ea523556f1 tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-868dccd4-65d5-4852-be26-e9713c6c5e91-delete_volume" released by "delete_volume" :: held 0.355s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fdb481-b405-47b3-846c-02ddf6aa7093]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.175s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.188s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:44 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a155b22-c88d-4a99-8463-c99a3acc34f3', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:47:44 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:44 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-277b77e9-d0ae-427c-bd7a-7d9a3cc4c8d1 req-5cc7db09-9186-4c6f-8afc-fdc4833c9d3e tempest-TestShelveInstance-1778332493 None] attachment_update completed successfully.
Sep 30 15:47:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:46 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-eb7836d9-6274-4951-abc8-86c6a953371b req-f9750077-9ae2-4ebc-ac8e-9f46fd86821e tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:46 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-eb7836d9-6274-4951-abc8-86c6a953371b req-f9750077-9ae2-4ebc-ac8e-9f46fd86821e tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:46 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-eb7836d9-6274-4951-abc8-86c6a953371b req-f9750077-9ae2-4ebc-ac8e-9f46fd86821e tempest-TestInstancesWithCinderVolumes-1664779642 None] Terminate volume connection completed successfully.
Sep 30 15:47:46 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-eb7836d9-6274-4951-abc8-86c6a953371b req-f9750077-9ae2-4ebc-ac8e-9f46fd86821e tempest-TestInstancesWithCinderVolumes-1664779642 None] Deleting attachment 58884f4f-e364-4991-98cd-fbfce50a3de0. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "cinder-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:49 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "cinder-quobyte-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-quobyte-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9281ae-d311-413e-b4a4-b6069b4285e8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:49 devstack quobyte-client[80089]: System call "getattr" of process 94418 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" returned: 0 in 0.160s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-quobyte-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597" released by "delete_volume" :: held 0.231s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:49 devstack cinder-volume[80302]: WARNING cinder.quota [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872182901-389234372 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872182901-389234372, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:47:49 devstack cinder-volume[80302]: WARNING cinder.quota [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872182901-389234372 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1872182901-389234372, it is now deprecated. Please use the default quota class for default quota.
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Created reservations ['e0f84b90-c7ad-46b0-95a1-572b038154a6', 'ca8cce11-e028-4386-8f95-94f3b67fd908', 'b01532dc-8dc2-45d3-bba4-d63e37d37cb0', 'db93aaaa-8a00-4669-a8c3-188ca4fca2fb'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:47:49 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:47:50 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:47:50 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:47:50 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Deleted volume successfully.
Sep 30 15:47:50 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-a953c699-98fd-4ac4-9caf-d7a54c98b20d tempest-TestInstancesWithCinderVolumes-1664779642 None] Lock "cinder-1b67d0f8-be7d-4611-ae26-f5a7c2a0c597-delete_volume" released by "delete_volume" :: held 0.399s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:47:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:47:59 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=17,cinder:SELECT=29,cinder:INSERT=10 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:48:00 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=11,cinder:DELETE=3 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:48:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:48:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:48:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:48:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:48:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-826b9a7c-9737-4003-a462-07a2eff060c8 req-cbf242ae-5d67-473b-984e-ad7bd5ec00d4 tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:49:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-826b9a7c-9737-4003-a462-07a2eff060c8 req-cbf242ae-5d67-473b-984e-ad7bd5ec00d4 tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:49:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-826b9a7c-9737-4003-a462-07a2eff060c8 req-cbf242ae-5d67-473b-984e-ad7bd5ec00d4 tempest-TestShelveInstance-1778332493 None] Terminate volume connection completed successfully.
Sep 30 15:49:04 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-826b9a7c-9737-4003-a462-07a2eff060c8 req-cbf242ae-5d67-473b-984e-ad7bd5ec00d4 tempest-TestShelveInstance-1778332493 None] Deleting attachment 8a155b22-c88d-4a99-8463-c99a3acc34f3. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:49:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4615c8-0938-42ca-9bd8-cf76c2a0da20]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.162s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.173s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:49:09 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '646f2978-9ba6-4d06-925b-cfbc12a5a367', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:49:09 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:49:09 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-fe3b24f5-51f2-4cf3-ac34-c6b41b5820a4 req-5a286708-4ecc-40cf-98da-b91dd3af1b6e tempest-TestShelveInstance-1778332493 None] attachment_update completed successfully.
Sep 30 15:49:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:19 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:49:19 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:49:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:30 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Flow 'volume_create_manager' (17571d68-3feb-4b16-848d-506d5f3ef173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e5529-19a1-45e7-9f48-258809de4f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e5529-19a1-45e7-9f48-258809de4f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-36771102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8143f9-35de-4bee-a652-b3570c43772f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f34616010e480e83e4d0d8aa2f2b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:49:31Z,use_quota=True,user_id='f2acf06f31ee48f991ed45028d11c49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560a504c-adc6-403d-b7c2-51bbc0b8ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560a504c-adc6-403d-b7c2-51bbc0b8ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65550ba5-f229-4f41-915d-23f7f627b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65550ba5-f229-4f41-915d-23f7f627b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8143f9-35de-4bee-a652-b3570c43772f', 'volume_name': 'volume-db8143f9-35de-4bee-a652-b3570c43772f', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4243f82-77b6-4995-bddf-7fed854bfdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4243f82-77b6-4995-bddf-7fed854bfdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3265fea1-643c-4ce0-8f2e-aa6875b10197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:49:30 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume db8143f9-35de-4bee-a652-b3570c43772f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8143f9-35de-4bee-a652-b3570c43772f', 'volume_size': 1}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-36771102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8143f9-35de-4bee-a652-b3570c43772f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f34616010e480e83e4d0d8aa2f2b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:49:31Z,use_quota=True,user_id='f2acf06f31ee48f991ed45028d11c49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Creating volume db8143f9-35de-4bee-a652-b3570c43772f {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:49:30 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:49:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:49:30 devstack quobyte-client[80089]: System call "getattr" of process 95300 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:49:30 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=130, name=volume-db8143f9-35de-4bee-a652-b3570c43772f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f 1073741824" returned: 0 in 0.121s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] <== create_volume: return (155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.158s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3265fea1-643c-4ce0-8f2e-aa6875b10197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8143f9-35de-4bee-a652-b3570c43772f', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cddee56-06a4-4cd3-86e5-0c13f82c5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:49:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume volume-db8143f9-35de-4bee-a652-b3570c43772f (db8143f9-35de-4bee-a652-b3570c43772f): created successfully
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cddee56-06a4-4cd3-86e5-0c13f82c5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:49:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Flow 'volume_create_manager' (17571d68-3feb-4b16-848d-506d5f3ef173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:49:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6a0cb150-8400-4f41-9a1a-fddfd28be67f tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Created volume successfully.
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562be07-0f4d-44a1-8097-23d5deb23a41]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.154s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:49:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718', 'name': 'volume-db8143f9-35de-4bee-a652-b3570c43772f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9677651b-eab6-4e17-ba8e-9f920dcf70b6', 'enforce_multipath': True} {{(pid=80302) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 15:49:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:49:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-958b3060-3333-4292-b9e7-f4e82f3e0431 req-262faab1-0ed7-44a2-bd22-d395df27d2b8 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] attachment_update completed successfully.
Sep 30 15:49:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:49:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:49:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:49:45 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:49:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:49:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-d24cb63f-7e32-483c-9520-97827951d172 req-3b3c1981-0cd8-485f-bab6-f317bcdba712 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:02 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-d24cb63f-7e32-483c-9520-97827951d172 req-3b3c1981-0cd8-485f-bab6-f317bcdba712 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-d24cb63f-7e32-483c-9520-97827951d172 req-3b3c1981-0cd8-485f-bab6-f317bcdba712 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Terminate volume connection completed successfully.
Sep 30 15:50:02 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-d24cb63f-7e32-483c-9520-97827951d172 req-3b3c1981-0cd8-485f-bab6-f317bcdba712 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Deleting attachment 9677651b-eab6-4e17-ba8e-9f920dcf70b6. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Acquiring lock "cinder-db8143f9-35de-4bee-a652-b3570c43772f-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "cinder-db8143f9-35de-4bee-a652-b3570c43772f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:04 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Acquiring lock "cinder-quobyte-db8143f9-35de-4bee-a652-b3570c43772f" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "cinder-quobyte-db8143f9-35de-4bee-a652-b3570c43772f" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe2301d-b76f-44ae-9ec8-1943367b5fc4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f" returned: 0 in 0.136s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-db8143f9-35de-4bee-a652-b3570c43772f" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "cinder-quobyte-db8143f9-35de-4bee-a652-b3570c43772f" released by "delete_volume" :: held 0.179s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Created reservations ['c97e2ca4-06b4-4e4e-aa1f-45bdaee2cc32', '00583b21-d9d2-4efb-aee2-a656bd705992', '42fff02f-8ae1-48b9-a5a7-9b9c958cac5d', '186ac5e9-68b4-4fc4-be59-a3127ffa9673'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:04 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Deleted volume successfully.
Sep 30 15:50:04 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-2ecd6b92-bb79-4a37-b77c-876dc9c87dd3 tempest-TestServerVolumeAttachScenarioOldVersion-926164371 None] Lock "cinder-db8143f9-35de-4bee-a652-b3570c43772f-delete_volume" released by "delete_volume" :: held 0.328s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:14 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=4 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:50:14 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:50:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (c54e7bac-e6f6-45ee-ad96-33a393f0b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7cb78a-0760-4627-8463-d416590bfd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7cb78a-0760-4627-8463-d416590bfd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198059712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64606425-18a7-4114-a925-959eb8bf8d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:20Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f75c597-f49c-48e4-bd6b-df204ad1718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f75c597-f49c-48e4-bd6b-df204ad1718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c5899f-df76-49f1-91b5-e3ed39b98c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c5899f-df76-49f1-91b5-e3ed39b98c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64606425-18a7-4114-a925-959eb8bf8d33', 'volume_name': 'volume-64606425-18a7-4114-a925-959eb8bf8d33', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e519215a-9ec5-4bfe-ad41-9bda03c0e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e519215a-9ec5-4bfe-ad41-9bda03c0e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ac5b5a-99ed-456f-bead-57ec3e4acb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Volume 64606425-18a7-4114-a925-959eb8bf8d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64606425-18a7-4114-a925-959eb8bf8d33', 'volume_size': 1}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198059712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64606425-18a7-4114-a925-959eb8bf8d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:20Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Creating volume 64606425-18a7-4114-a925-959eb8bf8d33 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "open" of process 95497 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "ioctl" of process 95497 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "open" of process 95497 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "ioctl" of process 95497 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:20 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=131, name=volume-64606425-18a7-4114-a925-959eb8bf8d33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (15a40100-6c3e-47a1-8e66-99295e88daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4712e1b-78ff-4439-b441-5ec59e19b0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33 1073741824" returned: 0 in 0.159s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4712e1b-78ff-4439-b441-5ec59e19b0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1231097123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4d7544-290f-4d03-a712-29574be92a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:20Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d9ddf-07bf-45fc-abe1-9015e69d7f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d9ddf-07bf-45fc-abe1-9015e69d7f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659e1888-7e00-46c4-bd2f-2420b9bf3262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659e1888-7e00-46c4-bd2f-2420b9bf3262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf4d7544-290f-4d03-a712-29574be92a72', 'volume_name': 'volume-bf4d7544-290f-4d03-a712-29574be92a72', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b683e57-b971-4ab5-a38a-56bf7899d9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b683e57-b971-4ab5-a38a-56bf7899d9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496a90bd-d83a-4a2d-b2ab-a51b1fe15b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Volume bf4d7544-290f-4d03-a712-29574be92a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf4d7544-290f-4d03-a712-29574be92a72', 'volume_size': 1}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33" returned: 0 in 0.050s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] <== create_volume: return (218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.221s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1231097123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4d7544-290f-4d03-a712-29574be92a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:20Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Creating volume bf4d7544-290f-4d03-a712-29574be92a72 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ac5b5a-99ed-456f-bead-57ec3e4acb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64606425-18a7-4114-a925-959eb8bf8d33', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a465ce-abe3-48fc-a6a3-c87935644c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Volume volume-64606425-18a7-4114-a925-959eb8bf8d33 (64606425-18a7-4114-a925-959eb8bf8d33): created successfully
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a465ce-abe3-48fc-a6a3-c87935644c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (c54e7bac-e6f6-45ee-ad96-33a393f0b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "getlk" of process 95501 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0f04580f-7d72-46b0-aa84-c73f404c42a6 tempest-CreateVolumesFromImageTest-1655739878 None] Created volume successfully.
Sep 30 15:50:20 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=132, name=volume-bf4d7544-290f-4d03-a712-29574be92a72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (5f897a9e-4ba6-4883-9401-c0475f4105aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc5ba9f-5951-4313-a531-4bc8f8d7d543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72 1073741824" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc5ba9f-5951-4313-a531-4bc8f8d7d543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027611320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64f61e3-f477-4c63-9881-a6182451a776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:21Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9206bb-fb74-457b-91eb-4855a53d52aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9206bb-fb74-457b-91eb-4855a53d52aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c8c2a6-0d0f-4ff3-94f2-71682eced75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c8c2a6-0d0f-4ff3-94f2-71682eced75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64f61e3-f477-4c63-9881-a6182451a776', 'volume_name': 'volume-c64f61e3-f477-4c63-9881-a6182451a776', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdd8ce4-c221-464b-a2a7-3232588bf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdd8ce4-c221-464b-a2a7-3232588bf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d804743f-0be2-4775-b4c7-103b586765c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Volume c64f61e3-f477-4c63-9881-a6182451a776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64f61e3-f477-4c63-9881-a6182451a776', 'volume_size': 1}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72" returned: 0 in 0.046s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] <== create_volume: return (207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.210s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027611320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64f61e3-f477-4c63-9881-a6182451a776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:21Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Creating volume c64f61e3-f477-4c63-9881-a6182451a776 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496a90bd-d83a-4a2d-b2ab-a51b1fe15b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4d7544-290f-4d03-a712-29574be92a72', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b85910-0b30-4898-8fbe-37992f96b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Volume volume-bf4d7544-290f-4d03-a712-29574be92a72 (bf4d7544-290f-4d03-a712-29574be92a72): created successfully
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b85910-0b30-4898-8fbe-37992f96b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=133, name=volume-c64f61e3-f477-4c63-9881-a6182451a776, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (15a40100-6c3e-47a1-8e66-99295e88daaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-03fd44e4-74b7-4033-b7d5-c60e1177dd7e tempest-CreateVolumesFromImageTest-1655739878 None] Created volume successfully.
Sep 30 15:50:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (a883596e-29be-465b-a882-564efd30bf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b123ab36-0a02-439d-8102-95c4619d178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b123ab36-0a02-439d-8102-95c4619d178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863881414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b270fb-2e91-4c33-b962-982d8a34ac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:21Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6b3f2d-0e88-4f7e-80f8-af167c6e329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6b3f2d-0e88-4f7e-80f8-af167c6e329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e53fcd3-2157-428d-b3d7-601593d00a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e53fcd3-2157-428d-b3d7-601593d00a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b270fb-2e91-4c33-b962-982d8a34ac69', 'volume_name': 'volume-c6b270fb-2e91-4c33-b962-982d8a34ac69', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b873657-4d61-445f-b5da-9d1d31af0dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b873657-4d61-445f-b5da-9d1d31af0dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad2be3-717c-4c3b-bdbc-b73733d7eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Volume c6b270fb-2e91-4c33-b962-982d8a34ac69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b270fb-2e91-4c33-b962-982d8a34ac69', 'volume_size': 1}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776 1073741824" returned: 0 in 0.200s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] <== create_volume: return (226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.229s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863881414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b270fb-2e91-4c33-b962-982d8a34ac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:21Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Creating volume c6b270fb-2e91-4c33-b962-982d8a34ac69 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d804743f-0be2-4775-b4c7-103b586765c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64f61e3-f477-4c63-9881-a6182451a776', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fe2da6-ac14-49be-98ba-8eecd210867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Volume volume-c64f61e3-f477-4c63-9881-a6182451a776 (c64f61e3-f477-4c63-9881-a6182451a776): created successfully
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fe2da6-ac14-49be-98ba-8eecd210867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:20 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (5f897a9e-4ba6-4883-9401-c0475f4105aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7985ae0c-2e21-436f-aebd-f28d7e96533e tempest-CreateVolumesFromImageTest-1655739878 None] Created volume successfully.
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "create" of process 95509 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:20 devstack quobyte-client[80089]: System call "getattr" of process 95509 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:21 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=134, name=volume-c6b270fb-2e91-4c33-b962-982d8a34ac69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (bd8c447c-ce8c-4397-8217-ad49b5348a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccf5f8c-2999-43de-929f-b84308fad10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccf5f8c-2999-43de-929f-b84308fad10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033406460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fca8dd-e658-4174-8140-7f7b4ae8b6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:21Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521a77fe-080b-4797-b291-e698debc80ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521a77fe-080b-4797-b291-e698debc80ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7c9621-890f-4f5d-ac98-8f5797b638c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7c9621-890f-4f5d-ac98-8f5797b638c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fca8dd-e658-4174-8140-7f7b4ae8b6a0', 'volume_name': 'volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c602f919-8c04-4e01-8dc8-a746ac3fe605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c602f919-8c04-4e01-8dc8-a746ac3fe605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc48bec9-062c-4f85-a068-afbc5f48d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Volume 38fca8dd-e658-4174-8140-7f7b4ae8b6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0', 'volume_size': 1}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69 1073741824" returned: 0 in 0.167s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] <== create_volume: return (197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.200s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033406460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fca8dd-e658-4174-8140-7f7b4ae8b6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e6f7a379704d3985094e0232e8c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:21Z,use_quota=True,user_id='2febf076ce0d4944bc789ebdf78fc587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Creating volume 38fca8dd-e658-4174-8140-7f7b4ae8b6a0 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:21 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad2be3-717c-4c3b-bdbc-b73733d7eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b270fb-2e91-4c33-b962-982d8a34ac69', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f97cd20-e68a-45db-9822-4f7fcf5c7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Volume volume-c6b270fb-2e91-4c33-b962-982d8a34ac69 (c6b270fb-2e91-4c33-b962-982d8a34ac69): created successfully
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f97cd20-e68a-45db-9822-4f7fcf5c7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=135, name=volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (a883596e-29be-465b-a882-564efd30bf14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bb6fd2ae-b14d-46bb-b9c4-5e826cfa9145 tempest-CreateVolumesFromImageTest-1655739878 None] Created volume successfully.
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0 1073741824" returned: 0 in 0.112s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] <== create_volume: return (135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.138s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc48bec9-062c-4f85-a068-afbc5f48d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cc16b0-aea5-4756-ad5f-0fd63e8de42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:21 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Volume volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0 (38fca8dd-e658-4174-8140-7f7b4ae8b6a0): created successfully
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cc16b0-aea5-4756-ad5f-0fd63e8de42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:21 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Flow 'volume_create_manager' (bd8c447c-ce8c-4397-8217-ad49b5348a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ded81cdc-8230-47dc-b151-4bac8d1d3c04 tempest-CreateVolumesFromImageTest-1655739878 None] Created volume successfully.
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-38fca8dd-e658-4174-8140-7f7b4ae8b6a0-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-38fca8dd-e658-4174-8140-7f7b4ae8b6a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-quobyte-38fca8dd-e658-4174-8140-7f7b4ae8b6a0" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-38fca8dd-e658-4174-8140-7f7b4ae8b6a0" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a285eac-f838-4bd5-be90-d7b4b2f8830f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-38fca8dd-e658-4174-8140-7f7b4ae8b6a0" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-38fca8dd-e658-4174-8140-7f7b4ae8b6a0" released by "delete_volume" :: held 0.167s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Created reservations ['a9c114d7-2c61-4786-9937-86955659bc31', '81e0dc66-f7f5-49c4-a99c-b47c0a011089', '74a53d42-dd72-46a3-9f63-0dd901048b83', 'c6f9217f-8c10-493a-9c69-5da0a2015bd8'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Deleted volume successfully.
Sep 30 15:50:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4b6e655e-476f-4333-a910-e74f3fef31c4 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-38fca8dd-e658-4174-8140-7f7b4ae8b6a0-delete_volume" released by "delete_volume" :: held 0.307s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-c6b270fb-2e91-4c33-b962-982d8a34ac69-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-c6b270fb-2e91-4c33-b962-982d8a34ac69-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-quobyte-c6b270fb-2e91-4c33-b962-982d8a34ac69" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-c6b270fb-2e91-4c33-b962-982d8a34ac69" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[247bfbb3-9936-4ecb-a217-8b15fd9e3050]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c6b270fb-2e91-4c33-b962-982d8a34ac69" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-c6b270fb-2e91-4c33-b962-982d8a34ac69" released by "delete_volume" :: held 0.172s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Created reservations ['ab2f7b41-b033-479a-af70-0946c668a63c', '27fad02a-bdc6-43a2-b48a-f6069386e814', '3699110b-d34b-4951-a7c5-02c0f9c655ea', '84ae1a7a-772d-4e6f-bcb1-f3d802233d62'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Deleted volume successfully.
Sep 30 15:50:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-80d15282-64db-484d-8516-6f625e6fded0 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-c6b270fb-2e91-4c33-b962-982d8a34ac69-delete_volume" released by "delete_volume" :: held 0.310s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-c64f61e3-f477-4c63-9881-a6182451a776-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-c64f61e3-f477-4c63-9881-a6182451a776-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:24 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-quobyte-c64f61e3-f477-4c63-9881-a6182451a776" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-c64f61e3-f477-4c63-9881-a6182451a776" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58d16cb-bcfc-41c0-80c6-6aed5a843b19]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776" returned: 0 in 0.173s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c64f61e3-f477-4c63-9881-a6182451a776" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-c64f61e3-f477-4c63-9881-a6182451a776" released by "delete_volume" :: held 0.211s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Created reservations ['0931f01d-7c4b-49fe-b6eb-2a5674c10987', 'eec34c9a-7acd-4a03-bd24-42a1011b944c', '5f419638-40fd-42e6-9259-ae58b74c6bce', '9bec3322-dfac-4319-a4fc-4a0eb1cfa99a'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:24 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Deleted volume successfully.
Sep 30 15:50:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-10e23e83-2b06-43b4-8793-88d543ca3eab tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-c64f61e3-f477-4c63-9881-a6182451a776-delete_volume" released by "delete_volume" :: held 0.344s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-bf4d7544-290f-4d03-a712-29574be92a72-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-bf4d7544-290f-4d03-a712-29574be92a72-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:25 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-quobyte-bf4d7544-290f-4d03-a712-29574be92a72" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-bf4d7544-290f-4d03-a712-29574be92a72" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a714db3-f54f-4911-a42d-1809f1f5911f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72" returned: 0 in 0.154s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-bf4d7544-290f-4d03-a712-29574be92a72" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-bf4d7544-290f-4d03-a712-29574be92a72" released by "delete_volume" :: held 0.196s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:25 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Created reservations ['742faed8-b1c7-4910-b66f-7aea3248720c', 'ea6f1741-def9-4be5-8d94-abb38775be20', '353898c6-d73a-4642-b064-899b1e21a15a', 'b84ec59c-2d21-4c2a-bcc7-110b60f8453a'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Deleted volume successfully.
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6024a74f-2373-40b3-8f42-9f77a7ab1267 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-bf4d7544-290f-4d03-a712-29574be92a72-delete_volume" released by "delete_volume" :: held 0.354s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-64606425-18a7-4114-a925-959eb8bf8d33-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-64606425-18a7-4114-a925-959eb8bf8d33-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "cinder-quobyte-64606425-18a7-4114-a925-959eb8bf8d33" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-64606425-18a7-4114-a925-959eb8bf8d33" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[83edf59f-a1b5-4207-9ad3-a6a9fb23776d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33" returned: 0 in 0.206s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-64606425-18a7-4114-a925-959eb8bf8d33" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-quobyte-64606425-18a7-4114-a925-959eb8bf8d33" released by "delete_volume" :: held 0.281s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Created reservations ['c29fa51f-2bb8-4d2c-b31e-f522b554ec1c', '59601b0a-01fc-4280-b7b2-1e2478d06296', '7cfd37e2-08c1-492b-9ae0-a6527bdbdfad', '5baa182a-dd1a-4790-b262-c4a26c484769'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Deleted volume successfully.
Sep 30 15:50:27 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-efd1625e-1189-429a-8a9b-e5020070ede9 tempest-CreateVolumesFromImageTest-1655739878 None] Lock "cinder-64606425-18a7-4114-a925-959eb8bf8d33-delete_volume" released by "delete_volume" :: held 0.453s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (cf801219-748f-484a-8561-2c4e9b47b240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afeba02e-ec84-4f2d-9a8c-cde37c841e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afeba02e-ec84-4f2d-9a8c-cde37c841e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985523071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be7f12b-5182-4a58-b7d0-9f56204338ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:30Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6ea9af-70a5-489b-8be6-b6284bc73b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6ea9af-70a5-489b-8be6-b6284bc73b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a59339-421b-4afe-ac3e-d9eef6a644b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a59339-421b-4afe-ac3e-d9eef6a644b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be7f12b-5182-4a58-b7d0-9f56204338ef', 'volume_name': 'volume-4be7f12b-5182-4a58-b7d0-9f56204338ef', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b77ecd1-978e-4057-b7a1-2af975cbacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b77ecd1-978e-4057-b7a1-2af975cbacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0cd560-8e08-43e6-beb2-db8d8a2c14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume 4be7f12b-5182-4a58-b7d0-9f56204338ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be7f12b-5182-4a58-b7d0-9f56204338ef', 'volume_size': 1}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985523071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be7f12b-5182-4a58-b7d0-9f56204338ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:30Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Creating volume 4be7f12b-5182-4a58-b7d0-9f56204338ef {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:29 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=136, name=volume-4be7f12b-5182-4a58-b7d0-9f56204338ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef 1073741824" returned: 0 in 0.107s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] <== create_volume: return (130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.132s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0cd560-8e08-43e6-beb2-db8d8a2c14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be7f12b-5182-4a58-b7d0-9f56204338ef', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01e4db6-d3e5-47c0-a0c6-db9a7127004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume volume-4be7f12b-5182-4a58-b7d0-9f56204338ef (4be7f12b-5182-4a58-b7d0-9f56204338ef): created successfully
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01e4db6-d3e5-47c0-a0c6-db9a7127004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (cf801219-748f-484a-8561-2c4e9b47b240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-756f8eb4-ff02-4270-ad0c-a8b30f1a5757 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created volume successfully.
Sep 30 15:50:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-9958cfdd-24b1-4a4c-9570-57f57d9ea191 tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-9958cfdd-24b1-4a4c-9570-57f57d9ea191 tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-9958cfdd-24b1-4a4c-9570-57f57d9ea191 tempest-TestShelveInstance-1778332493 None] Terminate volume connection completed successfully.
Sep 30 15:50:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-9958cfdd-24b1-4a4c-9570-57f57d9ea191 tempest-TestShelveInstance-1778332493 None] Deleting attachment 646f2978-9ba6-4d06-925b-cfbc12a5a367. {{(pid=80302) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 15:50:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Acquiring lock "cinder-48677e59-0d26-4c8a-8fb5-fc863d012dd4-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Lock "cinder-48677e59-0d26-4c8a-8fb5-fc863d012dd4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:30 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Acquiring lock "cinder-quobyte-48677e59-0d26-4c8a-8fb5-fc863d012dd4" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Lock "cinder-quobyte-48677e59-0d26-4c8a-8fb5-fc863d012dd4" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2bf094-4740-41cf-b9b6-57b04ce7bf4d]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.160s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-48677e59-0d26-4c8a-8fb5-fc863d012dd4" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Lock "cinder-quobyte-48677e59-0d26-4c8a-8fb5-fc863d012dd4" released by "delete_volume" :: held 0.205s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.quota [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Created reservations ['2c0ecb04-0bc5-4807-b747-553e6e2b391d', '69071212-3ddb-469b-86f7-9cfc02829fc6', 'dad930ed-fb1e-492b-8b5d-5f4834952528', 'cbe96962-07b4-486a-acae-a502b108588a'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.041s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.manager [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:30 devstack cinder-volume[80302]: INFO cinder.volume.manager [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Deleted volume successfully.
Sep 30 15:50:30 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (ac865603-8264-427c-a88f-6dc8272f47df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5b050e-bd2f-42d0-bc27-b780b05d80f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5b050e-bd2f-42d0-bc27-b780b05d80f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409615547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9348ef2-0441-4923-806a-c5721fdf6f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3599635-e7a0-4e9b-9efd-b514384158ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3599635-e7a0-4e9b-9efd-b514384158ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50833ef1-5675-4061-bb26-d5034b560625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50833ef1-5675-4061-bb26-d5034b560625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9348ef2-0441-4923-806a-c5721fdf6f4e', 'volume_name': 'volume-c9348ef2-0441-4923-806a-c5721fdf6f4e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb673169-a73a-45e4-b24c-9c6c132600af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb673169-a73a-45e4-b24c-9c6c132600af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bb4e20-b7f7-457a-8d43-ae560d1610dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:30 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume c9348ef2-0441-4923-806a-c5721fdf6f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9348ef2-0441-4923-806a-c5721fdf6f4e', 'volume_size': 1}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409615547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9348ef2-0441-4923-806a-c5721fdf6f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Creating volume c9348ef2-0441-4923-806a-c5721fdf6f4e {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:30 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [req-0ce37b2a-96d3-402b-ade4-d535e91401ec req-57f627d6-27c6-470d-b34d-5f371ca59ca2 tempest-TestShelveInstance-1778332493 None] Lock "cinder-48677e59-0d26-4c8a-8fb5-fc863d012dd4-delete_volume" released by "delete_volume" :: held 0.491s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=137, name=volume-c9348ef2-0441-4923-806a-c5721fdf6f4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (e13eb918-f0b0-47f2-90a5-d1066bc5564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f3ba3-76fb-4747-9477-7522e208d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f3ba3-76fb-4747-9477-7522e208d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-267564332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376958fe-c3e8-4b28-8aff-5b8f8b35cb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ed8b95-77d7-433e-a149-049546e64bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ed8b95-77d7-433e-a149-049546e64bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713078c4-129b-4ca4-b492-6afcc8065048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713078c4-129b-4ca4-b492-6afcc8065048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376958fe-c3e8-4b28-8aff-5b8f8b35cb93', 'volume_name': 'volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5d2dad-e557-4dce-a6ed-f1f360425cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5d2dad-e557-4dce-a6ed-f1f360425cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148fc6bf-2ed8-40dc-b16f-aabe2a060708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume 376958fe-c3e8-4b28-8aff-5b8f8b35cb93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93', 'volume_size': 1}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e 1073741824" returned: 0 in 0.169s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] <== create_volume: return (197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.199s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-267564332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376958fe-c3e8-4b28-8aff-5b8f8b35cb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Creating volume 376958fe-c3e8-4b28-8aff-5b8f8b35cb93 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bb4e20-b7f7-457a-8d43-ae560d1610dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9348ef2-0441-4923-806a-c5721fdf6f4e', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c29bd4-7f54-471a-a119-a8ecb4a0c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume volume-c9348ef2-0441-4923-806a-c5721fdf6f4e (c9348ef2-0441-4923-806a-c5721fdf6f4e): created successfully
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c29bd4-7f54-471a-a119-a8ecb4a0c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (ac865603-8264-427c-a88f-6dc8272f47df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-965e41ab-89c9-48c0-be7a-188ba89bff04 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created volume successfully.
Sep 30 15:50:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=138, name=volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (94e8ceca-c9d9-49b5-8676-cce81e11b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872064b-b98b-4621-b47e-dfe899e842ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872064b-b98b-4621-b47e-dfe899e842ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347070084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b21852b-925a-4d29-915a-07b2fb35b710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261cca6-e7f1-48eb-88b5-29eca5217735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261cca6-e7f1-48eb-88b5-29eca5217735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0525b8-c767-4fbd-9c22-f037553596fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0525b8-c767-4fbd-9c22-f037553596fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b21852b-925a-4d29-915a-07b2fb35b710', 'volume_name': 'volume-2b21852b-925a-4d29-915a-07b2fb35b710', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874fbee2-5c48-40fa-aac1-f7f1f9171432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874fbee2-5c48-40fa-aac1-f7f1f9171432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431de079-87c6-44e7-ae47-bc2621dfebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume 2b21852b-925a-4d29-915a-07b2fb35b710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b21852b-925a-4d29-915a-07b2fb35b710', 'volume_size': 1}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93 1073741824" returned: 0 in 0.151s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] <== create_volume: return (189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.191s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347070084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b21852b-925a-4d29-915a-07b2fb35b710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Creating volume 2b21852b-925a-4d29-915a-07b2fb35b710 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148fc6bf-2ed8-40dc-b16f-aabe2a060708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ac40fa-4f12-4675-ae8d-cf17d3f6d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=139, name=volume-2b21852b-925a-4d29-915a-07b2fb35b710, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93 (376958fe-c3e8-4b28-8aff-5b8f8b35cb93): created successfully
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ac40fa-4f12-4675-ae8d-cf17d3f6d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack quobyte-client[80089]: System call "open" of process 95613 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (e13eb918-f0b0-47f2-90a5-d1066bc5564f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0a87f36c-81b7-44b6-8735-993eb46e8687 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created volume successfully.
Sep 30 15:50:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (2a143240-2f5c-46bc-bd68-d97c45bf5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38213524-c8ab-4085-9879-3c461c25cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38213524-c8ab-4085-9879-3c461c25cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2127568869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4a888e-5e37-4b6f-929e-f89bac2c44f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747d9c62-9472-416c-9303-39a6f835beb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747d9c62-9472-416c-9303-39a6f835beb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aab0658-8d5f-4ba7-aad4-4703158ee930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aab0658-8d5f-4ba7-aad4-4703158ee930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4a888e-5e37-4b6f-929e-f89bac2c44f9', 'volume_name': 'volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450ad9bc-64fe-4777-bd5e-20bb7df81a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450ad9bc-64fe-4777-bd5e-20bb7df81a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4196a6c1-6f24-436d-93fb-6fc5c00c4720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume 7e4a888e-5e37-4b6f-929e-f89bac2c44f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9', 'volume_size': 1}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710 1073741824" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] <== create_volume: return (164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.166s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2127568869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4a888e-5e37-4b6f-929e-f89bac2c44f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:31Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Creating volume 7e4a888e-5e37-4b6f-929e-f89bac2c44f9 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431de079-87c6-44e7-ae47-bc2621dfebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b21852b-925a-4d29-915a-07b2fb35b710', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcc6c11-b637-45e7-8bcb-285220928e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume volume-2b21852b-925a-4d29-915a-07b2fb35b710 (2b21852b-925a-4d29-915a-07b2fb35b710): created successfully
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcc6c11-b637-45e7-8bcb-285220928e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (94e8ceca-c9d9-49b5-8676-cce81e11b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-674e2231-57e6-4e3a-96bf-57c3133e1b6a tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created volume successfully.
Sep 30 15:50:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=140, name=volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (0f9183bb-1719-4d14-9899-686b21fcd58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e115d50-cfd3-4299-8f3a-0c9b634fb89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9 1073741824" returned: 0 in 0.174s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e115d50-cfd3-4299-8f3a-0c9b634fb89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115138609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf1cb9b-c7e4-47ca-9042-1e56be267d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:32Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b4939e-91f1-40cb-93ca-b0fa79b48680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b4939e-91f1-40cb-93ca-b0fa79b48680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d9e8ce-416f-4c0d-8ba2-9c85f5932303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d9e8ce-416f-4c0d-8ba2-9c85f5932303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf1cb9b-c7e4-47ca-9042-1e56be267d7c', 'volume_name': 'volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd126469-10ae-464d-837d-b71c42213aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd126469-10ae-464d-837d-b71c42213aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810266bf-6b51-47ba-85a9-162e712c6668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume fdf1cb9b-c7e4-47ca-9042-1e56be267d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c', 'volume_size': 1}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9" returned: 0 in 0.062s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] <== create_volume: return (241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.245s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115138609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf1cb9b-c7e4-47ca-9042-1e56be267d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57767a5891ed40c197f7072fc461c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:32Z,use_quota=True,user_id='01412846d0244f7193ebc961ed932aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Creating volume fdf1cb9b-c7e4-47ca-9042-1e56be267d7c {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4196a6c1-6f24-436d-93fb-6fc5c00c4720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e1ebcb-a609-4333-8f69-84af49313970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=141, name=volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9 (7e4a888e-5e37-4b6f-929e-f89bac2c44f9): created successfully
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e1ebcb-a609-4333-8f69-84af49313970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack quobyte-client[80089]: System call "getattr" of process 95621 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:31 devstack quobyte-client[80089]: System call "open" of process 95621 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (2a143240-2f5c-46bc-bd68-d97c45bf5454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e9d0ca8c-1ad9-4861-ac45-3ce043909fdf tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created volume successfully.
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c 1073741824" returned: 0 in 0.119s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] <== create_volume: return (144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.147s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810266bf-6b51-47ba-85a9-162e712c6668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ecece-43cc-4d8d-85ac-7bcaa7b99448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c (fdf1cb9b-c7e4-47ca-9042-1e56be267d7c): created successfully
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ecece-43cc-4d8d-85ac-7bcaa7b99448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Flow 'volume_create_manager' (0f9183bb-1719-4d14-9899-686b21fcd58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-18805908-4d60-41e5-92ad-0f01eb2ebf5d tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created volume successfully.
Sep 30 15:50:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-quobyte-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9302b68-d0b8-4e3a-979e-e65417063a44]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c" returned: 0 in 0.144s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c" released by "delete_volume" :: held 0.197s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created reservations ['4b24c998-deb2-4ce2-8697-71316781ff46', 'adf21737-3f81-4a26-a255-cad58a100595', '3a1293e4-fb11-4257-9579-87088c4feb12', '3fd23191-2376-49d6-97c3-927d47b0eb62'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Deleted volume successfully.
Sep 30 15:50:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-51e37980-3944-4dd1-8c87-5f89e345928b tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-fdf1cb9b-c7e4-47ca-9042-1e56be267d7c-delete_volume" released by "delete_volume" :: held 0.333s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-7e4a888e-5e37-4b6f-929e-f89bac2c44f9-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-7e4a888e-5e37-4b6f-929e-f89bac2c44f9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-quobyte-7e4a888e-5e37-4b6f-929e-f89bac2c44f9" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-7e4a888e-5e37-4b6f-929e-f89bac2c44f9" acquired by "delete_volume" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1c2897-f341-44fe-b692-a2aaa7bff0d4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-7e4a888e-5e37-4b6f-929e-f89bac2c44f9" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-7e4a888e-5e37-4b6f-929e-f89bac2c44f9" released by "delete_volume" :: held 0.177s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created reservations ['ab4dc5ad-3d00-4dae-83fb-69e4a4b618ee', '400c4b99-6e87-4130-9607-3212be8e2600', 'dcb9b505-083a-477b-a451-d250a5eea7d1', '89a57258-8002-4abe-bcff-1a6a2041fdc2'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Deleted volume successfully.
Sep 30 15:50:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e70b7f43-e3e5-4f59-83d1-d2b223b3f9d3 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-7e4a888e-5e37-4b6f-929e-f89bac2c44f9-delete_volume" released by "delete_volume" :: held 0.308s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-2b21852b-925a-4d29-915a-07b2fb35b710-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-2b21852b-925a-4d29-915a-07b2fb35b710-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-quobyte-2b21852b-925a-4d29-915a-07b2fb35b710" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-2b21852b-925a-4d29-915a-07b2fb35b710" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65fc791-12c3-4918-a423-06129d54c44b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710" returned: 0 in 0.138s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2b21852b-925a-4d29-915a-07b2fb35b710" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-2b21852b-925a-4d29-915a-07b2fb35b710" released by "delete_volume" :: held 0.198s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created reservations ['7ad2e98d-c158-4bf0-b815-1645b729f2b2', '465b6830-d1d3-441d-97f6-b4552f7d71ce', 'cb48964e-6b38-4b0e-addb-0a393728d8c6', '0f05de04-9392-46a1-b0e4-6112aa8c6aa9'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:35 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Deleted volume successfully.
Sep 30 15:50:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-cb18dd36-546f-42c2-a13d-e4fb3c7983fa tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-2b21852b-925a-4d29-915a-07b2fb35b710-delete_volume" released by "delete_volume" :: held 0.344s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-376958fe-c3e8-4b28-8aff-5b8f8b35cb93-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-376958fe-c3e8-4b28-8aff-5b8f8b35cb93-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:36 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-quobyte-376958fe-c3e8-4b28-8aff-5b8f8b35cb93" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-376958fe-c3e8-4b28-8aff-5b8f8b35cb93" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8149f5e-6fa5-4281-97ba-06ffa72d202e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-376958fe-c3e8-4b28-8aff-5b8f8b35cb93" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-376958fe-c3e8-4b28-8aff-5b8f8b35cb93" released by "delete_volume" :: held 0.206s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created reservations ['3d8b7bf1-4607-42a0-8f15-30a286a92f9e', '50907675-1e8a-4be4-9068-ea57bac54403', 'a0c6955c-f479-40eb-9578-92dedecc5f02', '90e63187-fbb9-4c4c-9ea3-0452a2c3020b'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Deleted volume successfully.
Sep 30 15:50:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ed724796-199c-4d45-bd7a-ace8a959adb9 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-376958fe-c3e8-4b28-8aff-5b8f8b35cb93-delete_volume" released by "delete_volume" :: held 0.381s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-c9348ef2-0441-4923-806a-c5721fdf6f4e-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-c9348ef2-0441-4923-806a-c5721fdf6f4e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-quobyte-c9348ef2-0441-4923-806a-c5721fdf6f4e" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-c9348ef2-0441-4923-806a-c5721fdf6f4e" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[40728a4d-3703-4207-a8a1-950c85646e1c]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c9348ef2-0441-4923-806a-c5721fdf6f4e" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-c9348ef2-0441-4923-806a-c5721fdf6f4e" released by "delete_volume" :: held 0.196s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created reservations ['045e6f2c-d496-4332-a5d4-1e5d20b62858', 'b072d7b5-6812-417b-bf63-639158f8950a', '5681c4c8-e74c-49d3-8318-eef7d4bf4da5', '4f8b6de8-3ce0-4c2a-b5e7-ad899d8cda55'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Deleted volume successfully.
Sep 30 15:50:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7c930db9-77b3-4e15-a9c9-9c7c6480fb1e tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-c9348ef2-0441-4923-806a-c5721fdf6f4e-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-4be7f12b-5182-4a58-b7d0-9f56204338ef-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-4be7f12b-5182-4a58-b7d0-9f56204338ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "cinder-quobyte-4be7f12b-5182-4a58-b7d0-9f56204338ef" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-4be7f12b-5182-4a58-b7d0-9f56204338ef" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[14800b11-6e07-4e3d-bdd7-eb328ca375db]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef" returned: 0 in 0.140s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be7f12b-5182-4a58-b7d0-9f56204338ef" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-quobyte-4be7f12b-5182-4a58-b7d0-9f56204338ef" released by "delete_volume" :: held 0.184s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Created reservations ['e0af8c0c-5111-40eb-ac74-3c410fb050a5', '4404f2c1-07cc-48d5-879b-a19816cb9af6', '0c814390-1396-4c04-885b-9cddc7204dfb', '887dc92a-199c-41bb-baaf-8a4670363c72'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Deleted volume successfully.
Sep 30 15:50:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7e37cbc8-9054-47c2-9746-21634c6da566 tempest-CreateVolumesFromSourceVolumeTest-1678171020 None] Lock "cinder-4be7f12b-5182-4a58-b7d0-9f56204338ef-delete_volume" released by "delete_volume" :: held 0.348s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:50:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:48 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=71,cinder:UPDATE=130,cinder:DELETE=10,cinder:INSERT=24 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:50:48 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=74,cinder:UPDATE=107,cinder:DELETE=13,cinder:INSERT=24 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:50:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:50:53 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Flow 'volume_create_manager' (b2bdcb94-9bd5-4191-a918-38aed69fb408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f701f0-af43-4faa-b1a5-4741c0e4d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f701f0-af43-4faa-b1a5-4741c0e4d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-4224810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1b54b5-008c-4692-9aeb-41a7ffce9747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de63e17c75ac4ee89e4e77396b0694f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:54Z,use_quota=True,user_id='db2d262ba2014d2a8425d3c033b04454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a73db5-c47b-4798-959a-4ec1bbe1367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a73db5-c47b-4798-959a-4ec1bbe1367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a129100c-3765-419d-862d-9bae5cf872bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a129100c-3765-419d-862d-9bae5cf872bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1b54b5-008c-4692-9aeb-41a7ffce9747', 'volume_name': 'volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a269a5c-dc99-4126-964c-da47cbddd2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a269a5c-dc99-4126-964c-da47cbddd2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f3388a-827b-4c0d-b534-610ab013c78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:53 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Volume 2f1b54b5-008c-4692-9aeb-41a7ffce9747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747', 'volume_size': 1}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-4224810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1b54b5-008c-4692-9aeb-41a7ffce9747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de63e17c75ac4ee89e4e77396b0694f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:54Z,use_quota=True,user_id='db2d262ba2014d2a8425d3c033b04454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Creating volume 2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:53 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:50:53 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:53 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=142, name=volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:54 devstack quobyte-client[80089]: System call "getattr" of process 95663 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:54 devstack quobyte-client[80089]: System call "open" of process 95663 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 1073741824" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] <== create_volume: return (126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.128s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f3388a-827b-4c0d-b534-610ab013c78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f8b652-671f-4d60-90f9-22fca009d613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:54 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Volume volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 (2f1b54b5-008c-4692-9aeb-41a7ffce9747): created successfully
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f8b652-671f-4d60-90f9-22fca009d613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:54 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Flow 'volume_create_manager' (b2bdcb94-9bd5-4191-a918-38aed69fb408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:54 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-90a404f8-067f-4d17-9d84-f883ba480645 tempest-SnapshotDependencyTests-446641581 None] Created volume successfully.
Sep 30 15:50:55 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Creating offline snapshot 76862e27-bb41-4c63-a93a-b570ab981b8f of volume 2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db6b64-f4a8-4203-be62-a08f0cfb3319]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=143, name=volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f 1G" returned: 0 in 0.087s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "qemu-img rebase -u -b volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.017s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.info" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.info" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:55 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.353s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:55 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6d78642e-83b2-4b07-b5cf-a4f11a37616f tempest-SnapshotDependencyTests-446641581 None] Create snapshot completed successfully
Sep 30 15:50:56 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Flow 'volume_create_manager' (9b86ed2f-4622-49b3-882b-6edd24df5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f921de-8148-470a-856c-2a77c2f1b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f921de-8148-470a-856c-2a77c2f1b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb917063-5412-4e18-af18-42f86b29bb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de63e17c75ac4ee89e4e77396b0694f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=76862e27-bb41-4c63-a93a-b570ab981b8f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:50:56Z,use_quota=True,user_id='db2d262ba2014d2a8425d3c033b04454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c29b00-9a89-4c85-92d0-b813830e3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c29b00-9a89-4c85-92d0-b813830e3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a71b5a-ef52-430e-ba70-29221393a3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a71b5a-ef52-430e-ba70-29221393a3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb917063-5412-4e18-af18-42f86b29bb13', 'volume_name': 'volume-fb917063-5412-4e18-af18-42f86b29bb13', 'volume_size': 1, 'snapshot_id': '76862e27-bb41-4c63-a93a-b570ab981b8f'}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d623c66-e6d5-4c73-aa25-7b8da4e4472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d623c66-e6d5-4c73-aa25-7b8da4e4472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f85edd6-20a7-4284-9036-40dd2848c8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:56 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Volume fb917063-5412-4e18-af18-42f86b29bb13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb917063-5412-4e18-af18-42f86b29bb13', 'volume_size': 1, 'snapshot_id': '76862e27-bb41-4c63-a93a-b570ab981b8f'}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-quobyte-76862e27-bb41-4c63-a93a-b570ab981b8f-fb917063-5412-4e18-af18-42f86b29bb13" by "_create_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-76862e27-bb41-4c63-a93a-b570ab981b8f-fb917063-5412-4e18-af18-42f86b29bb13" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Creating volume fb917063-5412-4e18-af18-42f86b29bb13 from snapshot 76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:360}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-quobyte-fb917063-5412-4e18-af18-42f86b29bb13" by "_copy_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-fb917063-5412-4e18-af18-42f86b29bb13" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] snapshot: 76862e27-bb41-4c63-a93a-b570ab981b8f, volume: fb917063-5412-4e18-af18-42f86b29bb13,  {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30885cf-7ec1-44f8-afa4-6135c1552472]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.125s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:424}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Creating direct copy from snapshot {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:432}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3129d00-26d5-4833-923c-e1895daf7a71]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.142s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG cinder.utils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 not found in is_blk_device check {{(pid=80302) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 15:50:56 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:56 devstack quobyte-client[80089]: System call "getattr" of process 95686 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:56 devstack quobyte-client[80089]: System call "lookup" of process 95686 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:50:56 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=145, name=volume-fb917063-5412-4e18-af18-42f86b29bb13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13" returned: 0 in 1.390s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f17f1-bc2a-460b-b595-69ae8bf896a3]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.284s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Image conversion details: src /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747, size 1024.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:50:58 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Converted 1024.00 MB image at 735.89 MB/s
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-fb917063-5412-4e18-af18-42f86b29bb13" released by "_copy_volume_from_snapshot" :: held 2.019s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-76862e27-bb41-4c63-a93a-b570ab981b8f-fb917063-5412-4e18-af18-42f86b29bb13" released by "_create_volume_from_snapshot" :: held 2.037s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.045s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f85edd6-20a7-4284-9036-40dd2848c8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb917063-5412-4e18-af18-42f86b29bb13', 'volume_size': 1, 'snapshot_id': '76862e27-bb41-4c63-a93a-b570ab981b8f'}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c8244e-4976-41aa-b9ec-8164bd86af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:50:58 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Volume volume-fb917063-5412-4e18-af18-42f86b29bb13 (fb917063-5412-4e18-af18-42f86b29bb13): created successfully
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c8244e-4976-41aa-b9ec-8164bd86af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:50:58 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Flow 'volume_create_manager' (9b86ed2f-4622-49b3-882b-6edd24df5694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:50:58 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0b927796-04a1-443f-beb1-9218c4528ffe tempest-SnapshotDependencyTests-446641581 None] Created volume successfully.
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-76862e27-bb41-4c63-a93a-b570ab981b8f-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-76862e27-bb41-4c63-a93a-b570ab981b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:59 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-quobyte-2f1b54b5-008c-4692-9aeb-41a7ffce9747" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-2f1b54b5-008c-4692-9aeb-41a7ffce9747" acquired by "delete_snapshot" :: waited 0.023s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-quobyte-76862e27-bb41-4c63-a93a-b570ab981b8f" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-76862e27-bb41-4c63-a93a-b570ab981b8f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Deleting offline snapshot 76862e27-bb41-4c63-a93a-b570ab981b8f of volume 2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] snapshot_file for this snap is: volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b8bed-7961-42a2-b2f7-9c9067c09e4b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.129s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b31d2f4-f507-4f0c-b866-48f66f19741e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:50:59 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:50:59 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.124s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.060s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747.76862e27-bb41-4c63-a93a-b570ab981b8f" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-76862e27-bb41-4c63-a93a-b570ab981b8f" released by "_delete_snapshot" :: held 0.382s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-2f1b54b5-008c-4692-9aeb-41a7ffce9747" released by "delete_snapshot" :: held 0.395s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Created reservations ['1919b8a0-3729-4163-905b-c8c4a2ff7d6e', '7bab8e83-c39c-4be1-9f5f-a9bf94554c26', '7a21defa-1829-44b1-bd06-fcf09fbea8e2', '6b1504a7-292a-4a34-a04b-ea0f4b2c8ada'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:00 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Delete snapshot completed successfully.
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ffe629ff-e49c-4d93-b5a4-9994a0017725 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-76862e27-bb41-4c63-a93a-b570ab981b8f-delete_snapshot" released by "delete_snapshot" :: held 0.498s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-2f1b54b5-008c-4692-9aeb-41a7ffce9747-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-2f1b54b5-008c-4692-9aeb-41a7ffce9747-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:00 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-quobyte-2f1b54b5-008c-4692-9aeb-41a7ffce9747" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-2f1b54b5-008c-4692-9aeb-41a7ffce9747" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85c311-5d01-473f-8b54-1c183fa7718c]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:00 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.130s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2f1b54b5-008c-4692-9aeb-41a7ffce9747" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-2f1b54b5-008c-4692-9aeb-41a7ffce9747" released by "delete_volume" :: held 0.183s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Created reservations ['9166236f-b358-4a64-86ab-bc580c458c81', '89f1c9c9-12a2-4eaf-9817-396a7b7f3563', 'f1163988-08b5-4e37-bd25-e66429829e85', '531e1f78-51c6-4c04-8cac-cb0c166c5d51'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:01 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Deleted volume successfully.
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bf06b0dd-ca74-4a70-a006-ae5a2d1cf2ec tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-2f1b54b5-008c-4692-9aeb-41a7ffce9747-delete_volume" released by "delete_volume" :: held 0.319s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-fb917063-5412-4e18-af18-42f86b29bb13-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-fb917063-5412-4e18-af18-42f86b29bb13-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:01 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "cinder-quobyte-fb917063-5412-4e18-af18-42f86b29bb13" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:01 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-fb917063-5412-4e18-af18-42f86b29bb13" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d78259-b5c1-4c9d-b5fc-712ec84255ff]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13" returned: 0 in 0.119s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-fb917063-5412-4e18-af18-42f86b29bb13" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-quobyte-fb917063-5412-4e18-af18-42f86b29bb13" released by "delete_volume" :: held 0.163s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Created reservations ['234029d2-4d7b-41fd-a9ae-990d6de3b21c', 'd3a501b9-44da-44a1-8fb0-8d8c2a3e956f', '26c0a97e-9da7-4a74-914a-70ef1db831f4', '5dfe4948-c68b-4108-9b83-6674f9dec0aa'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:02 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Deleted volume successfully.
Sep 30 15:51:02 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-59132a36-6cf5-49fc-b8f7-f758bbea86a4 tempest-SnapshotDependencyTests-446641581 None] Lock "cinder-fb917063-5412-4e18-af18-42f86b29bb13-delete_volume" released by "delete_volume" :: held 0.302s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:07 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:12 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=24,cinder:DELETE=1,cinder:SELECT=18,cinder:INSERT=10 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:51:12 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=2 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:51:14 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (23bec54a-15dd-4a25-a693-b71683b3da39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672647bf-8876-43d7-a952-88630487c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672647bf-8876-43d7-a952-88630487c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105083079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabe1ba2-d970-447f-993c-cfd34473aff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:15Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a69a4-fab7-483f-8c66-d328349352d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a69a4-fab7-483f-8c66-d328349352d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa814dd7-0e7f-4315-a10e-b235c288e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa814dd7-0e7f-4315-a10e-b235c288e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eabe1ba2-d970-447f-993c-cfd34473aff6', 'volume_name': 'volume-eabe1ba2-d970-447f-993c-cfd34473aff6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfe5c9f-0df9-480f-ba9a-a2a2c47cfc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfe5c9f-0df9-480f-ba9a-a2a2c47cfc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8867847-2987-4dda-802b-ea60c014d986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Volume eabe1ba2-d970-447f-993c-cfd34473aff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eabe1ba2-d970-447f-993c-cfd34473aff6', 'volume_size': 1}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105083079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabe1ba2-d970-447f-993c-cfd34473aff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:15Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Creating volume eabe1ba2-d970-447f-993c-cfd34473aff6 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:15 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (639c4f7c-f353-47c9-8579-ba4253cfd451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:15 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=146, name=volume-eabe1ba2-d970-447f-993c-cfd34473aff6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c32013-9bcf-44b7-a364-9346e7e9d566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (0a843f2e-1aea-48d8-8b8e-68d98184cc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d8c53e-17a9-48db-9816-7d2e447562bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c32013-9bcf-44b7-a364-9346e7e9d566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-859787018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070201af-0d3d-4a05-9787-acbbe49ec4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282772b-2b24-4be0-a670-3af311eb342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282772b-2b24-4be0-a670-3af311eb342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01c90a1-e086-4541-8c8f-a9964fbd844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01c90a1-e086-4541-8c8f-a9964fbd844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070201af-0d3d-4a05-9787-acbbe49ec4f0', 'volume_name': 'volume-070201af-0d3d-4a05-9787-acbbe49ec4f0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc35614-a778-474d-bca6-ecb031d9a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc35614-a778-474d-bca6-ecb031d9a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237a96f4-ff4a-45b6-9232-4abfe1460d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Volume 070201af-0d3d-4a05-9787-acbbe49ec4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070201af-0d3d-4a05-9787-acbbe49ec4f0', 'volume_size': 1}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d8c53e-17a9-48db-9816-7d2e447562bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102115233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253b7b48-570c-4628-9785-1b4e01eccb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcdf193-e779-47e1-a679-f812a045703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcdf193-e779-47e1-a679-f812a045703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eee6ab9-df16-4ea0-9ce9-477dc8c362a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eee6ab9-df16-4ea0-9ce9-477dc8c362a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253b7b48-570c-4628-9785-1b4e01eccb4c', 'volume_name': 'volume-253b7b48-570c-4628-9785-1b4e01eccb4c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a104ff1f-b45d-4880-a86c-97201c4824a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a104ff1f-b45d-4880-a86c-97201c4824a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a7292e-1350-4a78-b32f-1416356ce8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:15 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume 253b7b48-570c-4628-9785-1b4e01eccb4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253b7b48-570c-4628-9785-1b4e01eccb4c', 'volume_size': 1}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6 1073741824" returned: 0 in 0.279s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:15 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:15 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (062e088d-b9db-4fd4-a3a2-0aafeed677f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e03cd2-3201-46d7-a207-afe0bf0114f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e03cd2-3201-46d7-a207-afe0bf0114f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576852680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a56dfd-f497-4b77-953c-6c4af8f80d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4eb58c1-fe3e-4e03-b52c-a7030023fd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4eb58c1-fe3e-4e03-b52c-a7030023fd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522551c6-9614-462b-9cc9-9f1a290bed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522551c6-9614-462b-9cc9-9f1a290bed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a56dfd-f497-4b77-953c-6c4af8f80d65', 'volume_name': 'volume-44a56dfd-f497-4b77-953c-6c4af8f80d65', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fbdb0f-e383-47b2-857e-a5a2047780f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fbdb0f-e383-47b2-857e-a5a2047780f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfcfe96-1f6c-440b-9567-b2f01c04c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Volume 44a56dfd-f497-4b77-953c-6c4af8f80d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a56dfd-f497-4b77-953c-6c4af8f80d65', 'volume_size': 1}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6" returned: 0 in 0.099s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] <== create_volume: return (383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.385s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.151s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-859787018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070201af-0d3d-4a05-9787-acbbe49ec4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Creating volume 070201af-0d3d-4a05-9787-acbbe49ec4f0 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8867847-2987-4dda-802b-ea60c014d986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eabe1ba2-d970-447f-993c-cfd34473aff6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97591369-d793-483a-ab0f-bf902e01eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Volume volume-eabe1ba2-d970-447f-993c-cfd34473aff6 (eabe1ba2-d970-447f-993c-cfd34473aff6): created successfully
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97591369-d793-483a-ab0f-bf902e01eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (23bec54a-15dd-4a25-a693-b71683b3da39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b4bbd1d5-6ec9-46f4-a5df-3bb3a242a144 tempest-CreateVolumesFromImageTest-975709928 None] Created volume successfully.
Sep 30 15:51:16 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=147, name=volume-070201af-0d3d-4a05-9787-acbbe49ec4f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:16 devstack quobyte-client[80089]: System call "open" of process 95817 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0 1073741824" returned: 0 in 0.182s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0" returned: 0 in 0.047s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] <== create_volume: return (240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.243s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102115233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253b7b48-570c-4628-9785-1b4e01eccb4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Creating volume 253b7b48-570c-4628-9785-1b4e01eccb4c {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:16 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=148, name=volume-253b7b48-570c-4628-9785-1b4e01eccb4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (a08da242-e4b6-41bf-a9c6-89d43a8a2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461a5de2-bdb9-4df6-9159-aa8c7e373d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237a96f4-ff4a-45b6-9232-4abfe1460d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070201af-0d3d-4a05-9787-acbbe49ec4f0', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e9df9b-7b81-4877-b76a-f43aa01f4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c 1073741824" returned: 0 in 0.171s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Volume volume-070201af-0d3d-4a05-9787-acbbe49ec4f0 (070201af-0d3d-4a05-9787-acbbe49ec4f0): created successfully
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e9df9b-7b81-4877-b76a-f43aa01f4206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (639c4f7c-f353-47c9-8579-ba4253cfd451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461a5de2-bdb9-4df6-9159-aa8c7e373d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965999041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9305f572-1aa3-4cf4-bf03-590c50534ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bf4a97-25e9-43ad-820f-a41de587b018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bf4a97-25e9-43ad-820f-a41de587b018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668bf38a-e562-4d94-a8e0-6b1cd8c4bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668bf38a-e562-4d94-a8e0-6b1cd8c4bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9305f572-1aa3-4cf4-bf03-590c50534ea7', 'volume_name': 'volume-9305f572-1aa3-4cf4-bf03-590c50534ea7', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee70484-f0b2-44d1-aa2d-aaf454110c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee70484-f0b2-44d1-aa2d-aaf454110c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a470edee-96c3-4dfb-94c5-2ae36bf95b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Volume 9305f572-1aa3-4cf4-bf03-590c50534ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9305f572-1aa3-4cf4-bf03-590c50534ea7', 'volume_size': 1}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9a112cf0-db1b-4f55-b166-42f6748e1f6a tempest-CreateVolumesFromImageTest-975709928 None] Created volume successfully.
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c" returned: 0 in 0.051s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] <== create_volume: return (305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.312s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576852680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a56dfd-f497-4b77-953c-6c4af8f80d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Creating volume 44a56dfd-f497-4b77-953c-6c4af8f80d65 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (85854f55-c70b-4feb-a162-df719394732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7d56e5-10ab-4c02-bd08-e6ff4d9ea6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=149, name=volume-44a56dfd-f497-4b77-953c-6c4af8f80d65, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a7292e-1350-4a78-b32f-1416356ce8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253b7b48-570c-4628-9785-1b4e01eccb4c', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3832cf0-b160-4a95-bc49-87956d85bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7d56e5-10ab-4c02-bd08-e6ff4d9ea6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739097758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ef4b81-2e03-491d-b0a7-4461435cbd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3712e0d-cb1f-470a-8ddf-dd151b5a4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3712e0d-cb1f-470a-8ddf-dd151b5a4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be6e24e-9640-4b06-bff7-d1e6724c45b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be6e24e-9640-4b06-bff7-d1e6724c45b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ef4b81-2e03-491d-b0a7-4461435cbd08', 'volume_name': 'volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bf7864-e738-49c7-9c82-ce5516ce886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bf7864-e738-49c7-9c82-ce5516ce886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5e1ff5-371f-4ef8-a620-73f8feb3920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Volume a0ef4b81-2e03-491d-b0a7-4461435cbd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08', 'volume_size': 1}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume volume-253b7b48-570c-4628-9785-1b4e01eccb4c (253b7b48-570c-4628-9785-1b4e01eccb4c): created successfully
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3832cf0-b160-4a95-bc49-87956d85bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (0a843f2e-1aea-48d8-8b8e-68d98184cc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4612a9d8-018d-4654-9e34-4607cc98bd13 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created volume successfully.
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65 1073741824" returned: 0 in 0.191s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65" returned: 0 in 0.038s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] <== create_volume: return (236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.238s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965999041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9305f572-1aa3-4cf4-bf03-590c50534ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Creating volume 9305f572-1aa3-4cf4-bf03-590c50534ea7 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfcfe96-1f6c-440b-9567-b2f01c04c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a56dfd-f497-4b77-953c-6c4af8f80d65', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b933c7-02f4-44ae-a4ac-65f18d5b5c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Volume volume-44a56dfd-f497-4b77-953c-6c4af8f80d65 (44a56dfd-f497-4b77-953c-6c4af8f80d65): created successfully
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b933c7-02f4-44ae-a4ac-65f18d5b5c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:16 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (062e088d-b9db-4fd4-a3a2-0aafeed677f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:16 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-38b5c859-1f81-4e96-9a4c-653d8104ead9 tempest-CreateVolumesFromImageTest-975709928 None] Created volume successfully.
Sep 30 15:51:16 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=150, name=volume-9305f572-1aa3-4cf4-bf03-590c50534ea7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7 1073741824" returned: 0 in 0.149s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] <== create_volume: return (192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.206s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739097758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ef4b81-2e03-491d-b0a7-4461435cbd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391223bd431b4fe69ed00851487f4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:16Z,use_quota=True,user_id='b511c04186c5467b899df3b93b1b6a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Creating volume a0ef4b81-2e03-491d-b0a7-4461435cbd08 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a470edee-96c3-4dfb-94c5-2ae36bf95b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9305f572-1aa3-4cf4-bf03-590c50534ea7', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8601793d-d6d0-4819-8284-54034de3e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=151, name=volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Volume volume-9305f572-1aa3-4cf4-bf03-590c50534ea7 (9305f572-1aa3-4cf4-bf03-590c50534ea7): created successfully
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8601793d-d6d0-4819-8284-54034de3e6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (a08da242-e4b6-41bf-a9c6-89d43a8a2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-815d7518-9dcc-450e-8033-cb7a1cf36ff9 tempest-CreateVolumesFromImageTest-975709928 None] Created volume successfully.
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08 1073741824" returned: 0 in 0.116s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] <== create_volume: return (146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.149s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5e1ff5-371f-4ef8-a620-73f8feb3920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71589a1f-867d-4f36-ad2a-15d80d0fc3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Volume volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08 (a0ef4b81-2e03-491d-b0a7-4461435cbd08): created successfully
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71589a1f-867d-4f36-ad2a-15d80d0fc3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Flow 'volume_create_manager' (85854f55-c70b-4feb-a162-df719394732c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ee66f4a9-247a-426b-96c5-c2effdfeb7d3 tempest-CreateVolumesFromImageTest-975709928 None] Created volume successfully.
Sep 30 15:51:17 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Flow 'volume_create_manager' (a5a34bab-ed5f-425a-9704-a35912c338fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d78aa43-bfe4-413d-8358-8988b5e59954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d78aa43-bfe4-413d-8358-8988b5e59954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4dafaf-ce09-47f6-acbe-0fbbe087f70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec82644fed634ca5b2c481bf464eb521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:17Z,use_quota=True,user_id='3063922e26824f3ab505e9aa80646924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc2cc2c-cb73-42e1-8089-49e15bd4fc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc2cc2c-cb73-42e1-8089-49e15bd4fc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9301fe-a086-4e2b-b68e-d1394b401218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.image.glance [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Creating Keystone auth plugin from conf {{(pid=80302) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9301fe-a086-4e2b-b68e-d1394b401218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac4dafaf-ce09-47f6-acbe-0fbbe087f70a', 'volume_name': 'volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a', 'volume_size': 1, 'image_id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51602542ff3cc1be89cc07fea463a006', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec82644fed634ca5b2c481bf464eb521', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14e0a130a253d440c9d7f44d1f01209caa331fefaebff7b1d99e1b81f5c9162b619c1f0eb793a105e046c566471355f01ff2393213018ca4dda0c049f1023123', 'id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'created_at': datetime.datetime(2025, 9, 30, 13, 51, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423813d90>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fe2180-75c4-41fc-8d80-025ac43f936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fe2180-75c4-41fc-8d80-025ac43f936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d07cbd-91b2-4231-95c0-c942c57f4998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Volume ac4dafaf-ce09-47f6-acbe-0fbbe087f70a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a', 'volume_size': 1, 'image_id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51602542ff3cc1be89cc07fea463a006', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec82644fed634ca5b2c481bf464eb521', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14e0a130a253d440c9d7f44d1f01209caa331fefaebff7b1d99e1b81f5c9162b619c1f0eb793a105e046c566471355f01ff2393213018ca4dda0c049f1023123', 'id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'created_at': datetime.datetime(2025, 9, 30, 13, 51, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423813d90>}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Cloning ac4dafaf-ce09-47f6-acbe-0fbbe087f70a from image a35d1c8a-b3b4-401c-966e-9d428efbf9b1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'metadata': {}}]). {{(pid=80302) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c860c-7122-4192-8e03-44efa84406af]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-a0ef4b81-2e03-491d-b0a7-4461435cbd08-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:17 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (1d294aa6-a0cd-47c8-8521-38dfb5412b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b66110e-b985-4652-8911-b74d619b39b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD
Sep 30 15:51:17 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-a0ef4b81-2e03-491d-b0a7-4461435cbd08-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b66110e-b985-4652-8911-b74d619b39b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330332725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be39829-2cd4-44c7-bc9b-08df2938f0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:18Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc57a530-c6ce-4df5-bf0d-1942585fedfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc57a530-c6ce-4df5-bf0d-1942585fedfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae0fdd-b408-484a-8ad5-4e0749160cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae0fdd-b408-484a-8ad5-4e0749160cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be39829-2cd4-44c7-bc9b-08df2938f0e2', 'volume_name': 'volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a20f019-c316-474c-833a-abc0cad3c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a20f019-c316-474c-833a-abc0cad3c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4e97ad-93d7-4769-afa0-1d86251b4b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:17 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume 4be39829-2cd4-44c7-bc9b-08df2938f0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2', 'volume_size': 1}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330332725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be39829-2cd4-44c7-bc9b-08df2938f0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:18Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Creating volume 4be39829-2cd4-44c7-bc9b-08df2938f0e2 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:17 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack quobyte-client[80089]: System call "getattr" of process 95839 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:18 devstack quobyte-client[80089]: System call "lookup" of process 95839 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:18 devstack quobyte-client[80089]: System call "create" of process 95839 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:18 devstack quobyte-client[80089]: System call "getattr" of process 95839 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-quobyte-a0ef4b81-2e03-491d-b0a7-4461435cbd08" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-a0ef4b81-2e03-491d-b0a7-4461435cbd08" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:18 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=152, name=volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[72870ef8-49f4-4d1b-8694-ca0380c7012b]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2 1073741824" returned: 0 in 0.157s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (6810e409-2d7b-4e04-bb56-5c6c176100dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e05433-1e6c-4ccf-a72d-7c798fb77b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e05433-1e6c-4ccf-a72d-7c798fb77b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309056988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851d64f3-e65b-4080-9f36-222d6e9e13a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:18Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19869878-afd9-4dcc-b570-09f8354eb1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19869878-afd9-4dcc-b570-09f8354eb1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1633f1-f743-44aa-b342-98736975fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1633f1-f743-44aa-b342-98736975fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851d64f3-e65b-4080-9f36-222d6e9e13a7', 'volume_name': 'volume-851d64f3-e65b-4080-9f36-222d6e9e13a7', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017b827d-5994-49d8-9efa-99cfc193dfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017b827d-5994-49d8-9efa-99cfc193dfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d379e0dc-bf07-402a-8523-94c5f7bfa315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume 851d64f3-e65b-4080-9f36-222d6e9e13a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851d64f3-e65b-4080-9f36-222d6e9e13a7', 'volume_size': 1}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2" returned: 0 in 0.095s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] <== create_volume: return (263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.266s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309056988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851d64f3-e65b-4080-9f36-222d6e9e13a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:18Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Creating volume 851d64f3-e65b-4080-9f36-222d6e9e13a7 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4e97ad-93d7-4769-afa0-1d86251b4b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e45490-9f20-45bd-bb07-bf2ca83c59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2 (4be39829-2cd4-44c7-bc9b-08df2938f0e2): created successfully
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e45490-9f20-45bd-bb07-bf2ca83c59ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=153, name=volume-851d64f3-e65b-4080-9f36-222d6e9e13a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (1d294aa6-a0cd-47c8-8521-38dfb5412b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-8db0db52-46bc-4dcc-b21a-0c31274543c5 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created volume successfully.
Sep 30 15:51:18 devstack quobyte-client[80089]: System call "statfs" of process 95842 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08" returned: 0 in 0.372s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7 1073741824" returned: 0 in 0.195s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-a0ef4b81-2e03-491d-b0a7-4461435cbd08" returned: 0 in 0.052s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (d3933e52-1ca9-406a-8551-cfd03e9dd5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfb74b3-c9a3-43ea-9663-4cdde7c35efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-a0ef4b81-2e03-491d-b0a7-4461435cbd08" released by "delete_volume" :: held 0.485s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfb74b3-c9a3-43ea-9663-4cdde7c35efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986354271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c576ab52-d1ac-4678-a5fd-a2f8963b5be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:18Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d23656-7f97-4807-a252-5abc958f172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d23656-7f97-4807-a252-5abc958f172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab16666-4403-47d1-b7dd-8ba1cbbd24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab16666-4403-47d1-b7dd-8ba1cbbd24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c576ab52-d1ac-4678-a5fd-a2f8963b5be3', 'volume_name': 'volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7bcec2-1cd9-4cd9-9fde-6f421eed2ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7bcec2-1cd9-4cd9-9fde-6f421eed2ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e6e083-11f7-449f-9fce-6db7a177abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume c576ab52-d1ac-4678-a5fd-a2f8963b5be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3', 'volume_size': 1}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7" returned: 0 in 0.137s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] <== create_volume: return (341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.345s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986354271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c576ab52-d1ac-4678-a5fd-a2f8963b5be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:18Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Creating volume c576ab52-d1ac-4678-a5fd-a2f8963b5be3 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d379e0dc-bf07-402a-8523-94c5f7bfa315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851d64f3-e65b-4080-9f36-222d6e9e13a7', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435c6903-02f0-410d-8da3-1d992be164eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack quobyte-client[80089]: System call "getlk" of process 95856 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume volume-851d64f3-e65b-4080-9f36-222d6e9e13a7 (851d64f3-e65b-4080-9f36-222d6e9e13a7): created successfully
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435c6903-02f0-410d-8da3-1d992be164eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (6810e409-2d7b-4e04-bb56-5c6c176100dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:18 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=154, name=volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-dede78a6-c3bf-4a72-a050-edcc8b097997 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created volume successfully.
Sep 30 15:51:18 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (f2eaec24-1b33-4bf8-aa56-f0bec719b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb524b1a-b090-4be0-91e3-6d026f7e70b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb524b1a-b090-4be0-91e3-6d026f7e70b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097072669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:19Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be48833-5904-4d51-8686-32f338e4c9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be48833-5904-4d51-8686-32f338e4c9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b25928-1d1f-4934-985d-542ea7ac10c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b25928-1d1f-4934-985d-542ea7ac10c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c47e11-22cb-4bd6-b236-f3cd6e0b77a1', 'volume_name': 'volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3afb9-9314-4d25-92d4-82fe9fc37a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3afb9-9314-4d25-92d4-82fe9fc37a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6b6387-8677-4a95-aadb-3694ba116024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1', 'volume_size': 1}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Created reservations ['a05ecd94-c4dd-4442-917e-e243007536a4', '8ff8f89f-5463-4fce-8d64-fa770265caf1', '3bc1fe3d-e820-4edb-a0db-68f8d1ea668b', '6fe29859-92a7-4afb-8aa0-e7545b1b6958'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3 1073741824" returned: 0 in 0.198s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD
Sep 30 15:51:18 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3" returned: 0 in 0.124s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] <== create_volume: return (333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.339s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097072669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:19Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Creating volume d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:18 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:18 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (39888c97-d068-4dba-9ddb-368fdd6ea174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652e0fe8-3403-4d5a-b160-8693637b1a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-9305f572-1aa3-4cf4-bf03-590c50534ea7-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:19 devstack quobyte-client[80089]: System call "getattr" of process 95862 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Deleted volume successfully.
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e6e083-11f7-449f-9fce-6db7a177abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f24545-a9e6-40f3-ae43-37580a6481ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=155, name=volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652e0fe8-3403-4d5a-b160-8693637b1a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361429929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f7f1db-1146-4223-9007-51d90f3593b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:19Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab86604-b321-480e-84f8-94c16c860150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab86604-b321-480e-84f8-94c16c860150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766dca80-b473-4048-92ea-b8b0a78f101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766dca80-b473-4048-92ea-b8b0a78f101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f7f1db-1146-4223-9007-51d90f3593b6', 'volume_name': 'volume-e6f7f1db-1146-4223-9007-51d90f3593b6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284047be-951d-4ac6-a17f-80ebba685941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284047be-951d-4ac6-a17f-80ebba685941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e6cf56-5346-4e8c-9bc0-24eb73b5da5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume e6f7f1db-1146-4223-9007-51d90f3593b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f7f1db-1146-4223-9007-51d90f3593b6', 'volume_size': 1}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-804a4867-cdb7-4044-bae7-27e65616cb2f tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-a0ef4b81-2e03-491d-b0a7-4461435cbd08-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-9305f572-1aa3-4cf4-bf03-590c50534ea7-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3 (c576ab52-d1ac-4678-a5fd-a2f8963b5be3): created successfully
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f24545-a9e6-40f3-ae43-37580a6481ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (d3933e52-1ca9-406a-8551-cfd03e9dd5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ddde22c6-94c2-4050-b323-b51866606ccd tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created volume successfully.
Sep 30 15:51:19 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-quobyte-9305f572-1aa3-4cf4-bf03-590c50534ea7" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 1073741824" returned: 0 in 0.199s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-9305f572-1aa3-4cf4-bf03-590c50534ea7" acquired by "delete_volume" :: waited 0.025s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] <== create_volume: return (237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.241s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c039e-6e84-444c-b1ba-9d7638bac784]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361429929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f7f1db-1146-4223-9007-51d90f3593b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a5619925fa49269c44be2c52e45f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:19Z,use_quota=True,user_id='e1d126d14bbe45889d4723398ca33397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Creating volume e6f7f1db-1146-4223-9007-51d90f3593b6 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6b6387-8677-4a95-aadb-3694ba116024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231a0ffe-c939-41bc-b2df-f9b816c025f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 (d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1): created successfully
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231a0ffe-c939-41bc-b2df-f9b816c025f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (f2eaec24-1b33-4bf8-aa56-f0bec719b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:19 devstack quobyte-client[80089]: System call "getlk" of process 95866 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ae398369-d7a6-4b59-b2ec-5337525be69b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created volume successfully.
Sep 30 15:51:19 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=156, name=volume-e6f7f1db-1146-4223-9007-51d90f3593b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6 1073741824" returned: 0 in 0.153s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.183s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e6cf56-5346-4e8c-9bc0-24eb73b5da5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f7f1db-1146-4223-9007-51d90f3593b6', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de3eefd-8e76-4650-977c-9fef30c22357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume volume-e6f7f1db-1146-4223-9007-51d90f3593b6 (e6f7f1db-1146-4223-9007-51d90f3593b6): created successfully
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de3eefd-8e76-4650-977c-9fef30c22357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Flow 'volume_create_manager' (39888c97-d068-4dba-9ddb-368fdd6ea174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-46486e12-1984-4260-919b-9489b6b2ddb9 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created volume successfully.
Sep 30 15:51:19 devstack quobyte-client[80089]: System call "getattr" of process 95867 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7" returned: 0 in 0.255s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-9305f572-1aa3-4cf4-bf03-590c50534ea7" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-9305f572-1aa3-4cf4-bf03-590c50534ea7" released by "delete_volume" :: held 0.328s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Created reservations ['44626961-851a-49e3-b060-b529bc571703', '14a8a2d1-8c0c-4d1e-9d53-9106b5ac2297', '37e5aab1-23f7-4505-b05d-e0f03c811781', '609da8a0-7aa1-4dbe-bf1e-348142798724'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:19 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD" returned: 1 in 0.957s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Temporary image a35d1c8a-b3b4-401c-966e-9d428efbf9b1 is fetched for user 3063922e26824f3ab505e9aa80646924. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[31228d26-99da-4608-afd0-60e4104b782a]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:19 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Deleted volume successfully.
Sep 30 15:51:19 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0fcfb178-d45d-4fbf-9d02-5028acc62d55 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-9305f572-1aa3-4cf4-bf03-590c50534ea7-delete_volume" released by "delete_volume" :: held 0.570s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:19 devstack sudo[95877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD
Sep 30 15:51:19 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-44a56dfd-f497-4b77-953c-6c4af8f80d65-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-44a56dfd-f497-4b77-953c-6c4af8f80d65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-quobyte-44a56dfd-f497-4b77-953c-6c4af8f80d65" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-44a56dfd-f497-4b77-953c-6c4af8f80d65" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c39181a-8a1f-4667-99c7-5683c4b16599]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-e6f7f1db-1146-4223-9007-51d90f3593b6-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-e6f7f1db-1146-4223-9007-51d90f3593b6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:20 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-quobyte-e6f7f1db-1146-4223-9007-51d90f3593b6" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-e6f7f1db-1146-4223-9007-51d90f3593b6" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32adc1-2403-40a8-8110-f32eb9abf804]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65" returned: 0 in 0.165s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-44a56dfd-f497-4b77-953c-6c4af8f80d65" returned: 0 in 0.056s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-44a56dfd-f497-4b77-953c-6c4af8f80d65" released by "delete_volume" :: held 0.246s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Created reservations ['be12d391-4b9d-430e-9a41-7f31d005271c', '81f6d1e4-2b07-4c97-8754-3c372aea2738', '1bb1c273-e718-46cd-a7e3-70ac9470810b', '378725bf-3cc3-485e-993f-07b98ade5041'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:20 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD
Sep 30 15:51:20 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.050s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6" returned: 0 in 0.238s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Deleted volume successfully.
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-e6f7f1db-1146-4223-9007-51d90f3593b6" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-e6f7f1db-1146-4223-9007-51d90f3593b6" released by "delete_volume" :: held 0.295s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-e7d0c3a0-48b4-4eb5-a95e-5296aa5dfe35 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-44a56dfd-f497-4b77-953c-6c4af8f80d65-delete_volume" released by "delete_volume" :: held 0.527s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created reservations ['754d174f-41c2-4848-98a0-b5af156cbd77', '64d87b9b-e496-4828-9c1e-0b201106d8fc', 'fa30402a-336a-49a4-8e1c-80e445244f9e', 'e7eae9b7-abce-4591-b2d1-0afe1bba7dfa'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:20 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Deleted volume successfully.
Sep 30 15:51:20 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-7bf2c97e-ecda-4b9d-b523-194881c9b31b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-e6f7f1db-1146-4223-9007-51d90f3593b6-delete_volume" released by "delete_volume" :: held 0.522s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:21 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD" returned: 1 in 0.721s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4dafaf-ce09-47f6-acbe-0fbbe087f70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec82644fed634ca5b2c481bf464eb521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:17Z,use_quota=True,user_id='3063922e26824f3ab505e9aa80646924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Creating volume ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:21 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=157, name=volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a 1073741824" returned: 0 in 0.130s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] <== create_volume: return (167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.171s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Attempting download of a35d1c8a-b3b4-401c-966e-9d428efbf9b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'metadata': {}}])) to volume ac4dafaf-ce09-47f6-acbe-0fbbe087f70a. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4442ad-f769-4853-9053-7b8aa2024a48]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-070201af-0d3d-4a05-9787-acbbe49ec4f0-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-070201af-0d3d-4a05-9787-acbbe49ec4f0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-quobyte-070201af-0d3d-4a05-9787-acbbe49ec4f0" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-070201af-0d3d-4a05-9787-acbbe49ec4f0" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e6147e-8ad8-45f5-a63c-4221fbe1c9df]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:21 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh
Sep 30 15:51:21 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:21 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-quobyte-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[92db3d13-943e-413f-861a-4ca3343b87f8]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0" returned: 0 in 0.192s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-070201af-0d3d-4a05-9787-acbbe49ec4f0" returned: 0 in 0.057s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-070201af-0d3d-4a05-9787-acbbe49ec4f0" released by "delete_volume" :: held 0.279s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1" returned: 0 in 0.194s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Created reservations ['7c5e0535-0027-4c44-9244-697f786809b9', '98779e09-c928-44e5-9659-6f77d23b8986', '72182cc9-05d3-48fb-8fd9-2483cf5347e4', 'aae98043-2f82-4db5-b81b-dd5d45ec396e'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1" returned: 0 in 0.048s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1" released by "delete_volume" :: held 0.275s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created reservations ['8f6e224c-c29c-4035-ae03-834ad0b6ae40', 'f3b7114f-4648-445a-832e-4c1d80c8b997', '2ff4faff-1f5c-40f3-89e4-2107e7eb61ab', '342ccd37-2c0d-4efa-92f1-3945366375ef'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.026s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Deleted volume successfully.
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-f8135e3b-fffb-4adf-8495-e5d92f0e27e0 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-070201af-0d3d-4a05-9787-acbbe49ec4f0-delete_volume" released by "delete_volume" :: held 0.529s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:21 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Deleted volume successfully.
Sep 30 15:51:21 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-6cbba3c9-5c7f-4b42-ad27-81fe4beb435b tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-d2c47e11-22cb-4bd6-b236-f3cd6e0b77a1-delete_volume" released by "delete_volume" :: held 0.480s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:22 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh" returned: 0 in 0.704s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh
Sep 30 15:51:22 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-eabe1ba2-d970-447f-993c-cfd34473aff6-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:22 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-eabe1ba2-d970-447f-993c-cfd34473aff6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "cinder-quobyte-eabe1ba2-d970-447f-993c-cfd34473aff6" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-eabe1ba2-d970-447f-993c-cfd34473aff6" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3dc439-da2c-468d-8349-fedc85ceca15]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-c576ab52-d1ac-4678-a5fd-a2f8963b5be3-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-c576ab52-d1ac-4678-a5fd-a2f8963b5be3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:22 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh" returned: 1 in 0.623s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_lmjzlgwh' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4182d1-ce28-4feb-b1bd-b25537d8e907]: (4, 'raw') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-quobyte-c576ab52-d1ac-4678-a5fd-a2f8963b5be3" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-c576ab52-d1ac-4678-a5fd-a2f8963b5be3" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6" returned: 0 in 0.209s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e65c23c-ff80-46a3-a920-69ec8a97ba7f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-eabe1ba2-d970-447f-993c-cfd34473aff6" returned: 0 in 0.048s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-quobyte-eabe1ba2-d970-447f-993c-cfd34473aff6" released by "delete_volume" :: held 0.289s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Created reservations ['9fb7bf87-47a0-4dfd-bf45-1f1873b61d85', '2df6871c-24a3-4e14-ba6f-7eb0dcdabdb4', 'e3bc8d04-5156-43a4-964b-21f8e4a5d666', '78fcb5bf-382d-475d-ad8e-729e4e7f5a54'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:22 devstack sudo[95921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD
Sep 30 15:51:22 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3" returned: 0 in 0.164s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.054s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:22 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Deleted volume successfully.
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-c576ab52-d1ac-4678-a5fd-a2f8963b5be3" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-c576ab52-d1ac-4678-a5fd-a2f8963b5be3" released by "delete_volume" :: held 0.236s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ace8b324-8d99-4022-a835-615da60a4240 tempest-CreateVolumesFromImageTest-975709928 None] Lock "cinder-eabe1ba2-d970-447f-993c-cfd34473aff6-delete_volume" released by "delete_volume" :: held 0.504s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:22 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created reservations ['d752dd93-e3bd-41a4-a4d9-714ddf3770aa', '99e038f6-e055-43d0-8c70-8762dc8560d6', '99d4a0a8-1894-47e0-8db4-b918ec9ebe60', 'c0fb4c14-a95b-4176-9941-92632927cdb9'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.028s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:23 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Deleted volume successfully.
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-19b4e8dc-e280-487a-92bb-d77f62e59e87 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-c576ab52-d1ac-4678-a5fd-a2f8963b5be3-delete_volume" released by "delete_volume" :: held 0.456s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:23 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:23 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD
Sep 30 15:51:23 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-851d64f3-e65b-4080-9f36-222d6e9e13a7-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-851d64f3-e65b-4080-9f36-222d6e9e13a7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:23 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-quobyte-851d64f3-e65b-4080-9f36-222d6e9e13a7" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-851d64f3-e65b-4080-9f36-222d6e9e13a7" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261416f-36aa-49d4-8506-bc49942f25b9]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:23 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7" returned: 0 in 0.143s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-851d64f3-e65b-4080-9f36-222d6e9e13a7" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:24 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-851d64f3-e65b-4080-9f36-222d6e9e13a7" released by "delete_volume" :: held 0.209s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD' failed. Not Retrying. {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] a35d1c8a-b3b4-401c-966e-9d428efbf9b1 was raw, converting to qcow2 {{(pid=80302) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created reservations ['4f71a2a0-9cfc-47d2-9c30-58d2b3f63809', '2be0260e-4802-4298-9041-357ab07964d3', '11d02b75-bf16-45be-b97e-168b4aaddbce', 'c3db7ec1-3c3d-4f6b-b8c0-f7e2bfce45fe'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:24 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a
Sep 30 15:51:24 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:24 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Deleted volume successfully.
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0b8f0701-954d-4776-a34d-926ff97c5f1a tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-851d64f3-e65b-4080-9f36-222d6e9e13a7-delete_volume" released by "delete_volume" :: held 0.420s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:24 devstack quobyte-client[80089]: System call "lookup" of process 95946 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:24 devstack quobyte-client[80089]: System call "getattr" of process 95946 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:24 devstack quobyte-client[80089]: System call "open" of process 95946 (/usr/bin/qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:24 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" returned: 0 in 0.667s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a35d1c8a-b3b4-401c-966e-9d428efbf9b1_wu7u20padevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:51:24 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[92518eae-9d35-4d23-b6f3-609e8d8749ab]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:24 devstack quobyte-client[80089]: System call "getattr" of process 95949 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:24 devstack quobyte-client[80089]: System call "getattr" of process 95949 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:24 devstack quobyte-client[80089]: System call "open" of process 95949 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" returned: 0 in 0.168s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:24 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-4be39829-2cd4-44c7-bc9b-08df2938f0e2-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-4be39829-2cd4-44c7-bc9b-08df2938f0e2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:25 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-quobyte-4be39829-2cd4-44c7-bc9b-08df2938f0e2" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a 1G" returned: 0 in 0.078s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Downloaded image a35d1c8a-b3b4-401c-966e-9d428efbf9b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'metadata': {}}])) to volume ac4dafaf-ce09-47f6-acbe-0fbbe087f70a successfully. {{(pid=80302) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Temporary image a35d1c8a-b3b4-401c-966e-9d428efbf9b1 for user 3063922e26824f3ab505e9aa80646924 is deleted. {{(pid=80302) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.volume_utils [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Marking volume ac4dafaf-ce09-47f6-acbe-0fbbe087f70a as bootable. {{(pid=80302) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-4be39829-2cd4-44c7-bc9b-08df2938f0e2" acquired by "delete_volume" :: waited 0.017s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Copying metadata from image a35d1c8a-b3b4-401c-966e-9d428efbf9b1 to ac4dafaf-ce09-47f6-acbe-0fbbe087f70a. {{(pid=80302) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Creating volume glance metadata for volume ac4dafaf-ce09-47f6-acbe-0fbbe087f70a backed by image a35d1c8a-b3b4-401c-966e-9d428efbf9b1 with: {'image_id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51602542ff3cc1be89cc07fea463a006', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=80302) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a70986c-50a1-4c7d-a924-76501d2fd3e0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d07cbd-91b2-4231-95c0-c942c57f4998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a', 'volume_size': 1, 'image_id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51602542ff3cc1be89cc07fea463a006', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec82644fed634ca5b2c481bf464eb521', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14e0a130a253d440c9d7f44d1f01209caa331fefaebff7b1d99e1b81f5c9162b619c1f0eb793a105e046c566471355f01ff2393213018ca4dda0c049f1023123', 'id': 'a35d1c8a-b3b4-401c-966e-9d428efbf9b1', 'created_at': datetime.datetime(2025, 9, 30, 13, 51, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 13, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a35d1c8a-b3b4-401c-966e-9d428efbf9b1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff423813d90>}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7757e0b7-d458-4ba2-a385-77ef3e52cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:25 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Volume volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a (ac4dafaf-ce09-47f6-acbe-0fbbe087f70a): created successfully
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7757e0b7-d458-4ba2-a385-77ef3e52cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Flow 'volume_create_manager' (a5a34bab-ed5f-425a-9704-a35912c338fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:25 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c365b65e-0a4e-413a-8677-8e978772b1f0 tempest-VolumeImageDependencyTests-182588504 None] Created volume successfully.
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2" returned: 0 in 0.178s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4be39829-2cd4-44c7-bc9b-08df2938f0e2" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-4be39829-2cd4-44c7-bc9b-08df2938f0e2" released by "delete_volume" :: held 0.231s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created reservations ['216e24a0-b3e7-4906-96e1-f0173a09f943', 'd33a2537-b0ee-4a99-95c6-8159d41c0028', '15808c25-9cc4-4527-a31f-08940757dda9', '2b48c68d-a376-460c-908f-251acc24cfa1'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.040s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:25 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Deleted volume successfully.
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-d7baa802-abd9-4ce7-8e6a-258a0dd7b4d1 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-4be39829-2cd4-44c7-bc9b-08df2938f0e2-delete_volume" released by "delete_volume" :: held 0.427s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:25 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (45ab4305-459d-477a-aa76-de281bf9dd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464e1907-f9b2-4641-a5e5-b8bcb9be15f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464e1907-f9b2-4641-a5e5-b8bcb9be15f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010340559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e1fa0c-cc13-43e8-b249-36e53d56d093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:26Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c1b3c3-d761-47d2-8f94-01e3ee9c0e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c1b3c3-d761-47d2-8f94-01e3ee9c0e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d9a69d-794a-482f-96c0-503989b37a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d9a69d-794a-482f-96c0-503989b37a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e1fa0c-cc13-43e8-b249-36e53d56d093', 'volume_name': 'volume-69e1fa0c-cc13-43e8-b249-36e53d56d093', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d49dff-daa4-4279-9773-b49572cfa3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d49dff-daa4-4279-9773-b49572cfa3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5d6953-3a47-404c-bd22-5ca69fc93a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:25 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume 69e1fa0c-cc13-43e8-b249-36e53d56d093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e1fa0c-cc13-43e8-b249-36e53d56d093', 'volume_size': 1}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010340559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e1fa0c-cc13-43e8-b249-36e53d56d093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:26Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating volume 69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:25 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:25 devstack quobyte-client[80089]: System call "getlk" of process 95966 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:25 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=158, name=volume-69e1fa0c-cc13-43e8-b249-36e53d56d093, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:25 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Acquiring lock "cinder-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Lock "cinder-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Acquiring lock "cinder-quobyte-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Lock "cinder-quobyte-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 1073741824" returned: 0 in 0.167s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05de004-0d88-4a29-b326-25e7473c189e]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] <== create_volume: return (201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.203s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5d6953-3a47-404c-bd22-5ca69fc93a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e1fa0c-cc13-43e8-b249-36e53d56d093', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0df1c62-991e-49de-b5e6-00b592ddfdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:26 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 (69e1fa0c-cc13-43e8-b249-36e53d56d093): created successfully
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0df1c62-991e-49de-b5e6-00b592ddfdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (45ab4305-459d-477a-aa76-de281bf9dd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-122aec4a-b850-471b-95bd-986bee4385b5 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created volume successfully.
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-253b7b48-570c-4628-9785-1b4e01eccb4c-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-253b7b48-570c-4628-9785-1b4e01eccb4c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "cinder-quobyte-253b7b48-570c-4628-9785-1b4e01eccb4c" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-253b7b48-570c-4628-9785-1b4e01eccb4c" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b88c16-c53b-4cc7-b80f-580a72aa5bbf]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" returned: 0 in 0.176s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Lock "cinder-quobyte-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a" released by "delete_volume" :: held 0.240s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Created reservations ['9642d1df-1d8b-455a-b680-4a7d67a67d68', '0f9a0a1f-376d-443c-83b0-362011d0b4db', '3db8790a-390e-4b3e-b23b-637800e956d7', '72bcafa3-10d3-47d7-b60a-2df0c5e42a5b'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c" returned: 0 in 0.150s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Deleted volume successfully.
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-253b7b48-570c-4628-9785-1b4e01eccb4c" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-quobyte-253b7b48-570c-4628-9785-1b4e01eccb4c" released by "delete_volume" :: held 0.195s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4e47a164-da05-414c-a7e4-3bc25d1b0d4d tempest-VolumeImageDependencyTests-182588504 None] Lock "cinder-ac4dafaf-ce09-47f6-acbe-0fbbe087f70a-delete_volume" released by "delete_volume" :: held 0.425s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Created reservations ['94b44d81-8dc4-47a0-9fb4-bce115ef61df', 'ac4624ee-21f7-4101-8d04-39fa07325fc5', 'ab2d3a02-3292-4a69-b32d-006ec8104b03', '6967a131-d18a-4214-a288-000227906f2f'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:26 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Deleted volume successfully.
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-03b26b11-a9a8-4b2f-b799-2decbd018613 tempest-CreateVolumesFromSourceVolumeTest-565039044 None] Lock "cinder-253b7b48-570c-4628-9785-1b4e01eccb4c-delete_volume" released by "delete_volume" :: held 0.352s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:26 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating offline snapshot 12c230dc-adc9-4387-b798-e80b4433f016 of volume 69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0add2c-11a7-473e-9499-85aa9a8f1812]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:26 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093" returned: 0 in 0.172s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=159, name=volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 1G" returned: 0 in 0.134s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img rebase -u -b volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img rebase -u -b volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016" returned: 0 in 0.040s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.info" returned: 0 in 0.044s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.info" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:27 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.561s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:27 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-420d9814-cc51-435c-bcbe-597f4e098beb tempest-CreateVolumesFromSnapshotTest-152286275 None] Create snapshot completed successfully
Sep 30 15:51:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (0b645385-4d4c-4ed1-aa5b-0cdab37a41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6a0648-4d50-4ab5-abea-a2ae37ffe99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6a0648-4d50-4ab5-abea-a2ae37ffe99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-815879159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cadb80-91b9-4b89-8a03-e336668eb8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:28Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccfb238-cccd-4981-b479-89e45b7d02e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccfb238-cccd-4981-b479-89e45b7d02e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f827c27-e308-4331-a3ab-bfa59bd12556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f827c27-e308-4331-a3ab-bfa59bd12556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29cadb80-91b9-4b89-8a03-e336668eb8a1', 'volume_name': 'volume-29cadb80-91b9-4b89-8a03-e336668eb8a1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b64a312-b18d-4553-b035-10ebe0db678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b64a312-b18d-4553-b035-10ebe0db678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf569b2b-5b8c-4e71-837b-339caa02f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume 29cadb80-91b9-4b89-8a03-e336668eb8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29cadb80-91b9-4b89-8a03-e336668eb8a1', 'volume_size': 1}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-815879159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cadb80-91b9-4b89-8a03-e336668eb8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:28Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating volume 29cadb80-91b9-4b89-8a03-e336668eb8a1 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:28 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:28 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=161, name=volume-29cadb80-91b9-4b89-8a03-e336668eb8a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1 1073741824" returned: 0 in 0.147s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1" returned: 0 in 0.045s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] <== create_volume: return (198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.201s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf569b2b-5b8c-4e71-837b-339caa02f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29cadb80-91b9-4b89-8a03-e336668eb8a1', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db4b0ea-7bd4-4020-a0b8-896ea29395f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume volume-29cadb80-91b9-4b89-8a03-e336668eb8a1 (29cadb80-91b9-4b89-8a03-e336668eb8a1): created successfully
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db4b0ea-7bd4-4020-a0b8-896ea29395f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (0b645385-4d4c-4ed1-aa5b-0cdab37a41d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:28 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (c718729e-3706-4fee-8a78-f5c000b038ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015a2b9f-ac1a-4d03-9079-1be7f9fc8eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f8a219b9-b935-4952-a939-f9730da97738 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created volume successfully.
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015a2b9f-ac1a-4d03-9079-1be7f9fc8eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125481668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab66649-f33f-4a1c-a578-547e94c1d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:29Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6812356-2b09-4ce2-8d86-1b67e15128b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6812356-2b09-4ce2-8d86-1b67e15128b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a57eff1-fba4-42e3-b534-4b1e0b4b4aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a57eff1-fba4-42e3-b534-4b1e0b4b4aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab66649-f33f-4a1c-a578-547e94c1d27b', 'volume_name': 'volume-4ab66649-f33f-4a1c-a578-547e94c1d27b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cc5fae-ceee-4b50-a339-2d8ca22985fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cc5fae-ceee-4b50-a339-2d8ca22985fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f819c4b0-98c5-49ac-b7a5-a4c36f84b004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:28 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume 4ab66649-f33f-4a1c-a578-547e94c1d27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab66649-f33f-4a1c-a578-547e94c1d27b', 'volume_size': 1}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125481668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab66649-f33f-4a1c-a578-547e94c1d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:29Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating volume 4ab66649-f33f-4a1c-a578-547e94c1d27b {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:28 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:28 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=162, name=volume-4ab66649-f33f-4a1c-a578-547e94c1d27b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b 1073741824" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b" returned: 0 in 0.036s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] <== create_volume: return (195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:28 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.198s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f819c4b0-98c5-49ac-b7a5-a4c36f84b004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab66649-f33f-4a1c-a578-547e94c1d27b', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435caa53-062d-4d1f-ad1e-35dd64b03fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (5eb064ef-c048-4580-906f-0e4b0816ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9651a1-a0f4-4546-8c79-50f0cac57c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume volume-4ab66649-f33f-4a1c-a578-547e94c1d27b (4ab66649-f33f-4a1c-a578-547e94c1d27b): created successfully
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435caa53-062d-4d1f-ad1e-35dd64b03fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (c718729e-3706-4fee-8a78-f5c000b038ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9651a1-a0f4-4546-8c79-50f0cac57c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093793073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efa033e-f885-469c-a88d-fbb3b6edbfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:29Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bd0888-23c1-4be4-baba-f3aa59c60ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bd0888-23c1-4be4-baba-f3aa59c60ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf95136f-04ff-468c-a251-750510a51a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf95136f-04ff-468c-a251-750510a51a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0efa033e-f885-469c-a88d-fbb3b6edbfee', 'volume_name': 'volume-0efa033e-f885-469c-a88d-fbb3b6edbfee', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9055e8-ccdd-47eb-a504-f0e11a88242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9055e8-ccdd-47eb-a504-f0e11a88242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9deb324-01ac-4731-a8a3-8968da554b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume 0efa033e-f885-469c-a88d-fbb3b6edbfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0efa033e-f885-469c-a88d-fbb3b6edbfee', 'volume_size': 1}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093793073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efa033e-f885-469c-a88d-fbb3b6edbfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:29Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating volume 0efa033e-f885-469c-a88d-fbb3b6edbfee {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-c4b20a1c-0578-42cc-a186-08858c4c68be tempest-CreateVolumesFromSnapshotTest-152286275 None] Created volume successfully.
Sep 30 15:51:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=163, name=volume-0efa033e-f885-469c-a88d-fbb3b6edbfee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (f8bd1b8f-4c2f-4bf8-b150-c29738f5ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406cf47-9c43-4d05-80a9-9d2907f5dde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406cf47-9c43-4d05-80a9-9d2907f5dde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513377083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34307692-d1fd-439f-94f6-cd44dbf76067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:29Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d65ba9-622c-4962-b601-ddbfa2061316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d65ba9-622c-4962-b601-ddbfa2061316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedfc7ff-3601-4ff3-8e12-016cf018b486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedfc7ff-3601-4ff3-8e12-016cf018b486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34307692-d1fd-439f-94f6-cd44dbf76067', 'volume_name': 'volume-34307692-d1fd-439f-94f6-cd44dbf76067', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bd1c80-c6cc-4e14-915b-351f3d4fb207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bd1c80-c6cc-4e14-915b-351f3d4fb207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52861281-f7fa-481a-968a-02318ffa85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume 34307692-d1fd-439f-94f6-cd44dbf76067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34307692-d1fd-439f-94f6-cd44dbf76067', 'volume_size': 1}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee 1073741824" returned: 0 in 0.248s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee" returned: 0 in 0.030s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] <== create_volume: return (291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.304s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513377083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34307692-d1fd-439f-94f6-cd44dbf76067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:29Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating volume 34307692-d1fd-439f-94f6-cd44dbf76067 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9deb324-01ac-4731-a8a3-8968da554b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efa033e-f885-469c-a88d-fbb3b6edbfee', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00832a9c-4831-4742-8e4c-7fa564822aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume volume-0efa033e-f885-469c-a88d-fbb3b6edbfee (0efa033e-f885-469c-a88d-fbb3b6edbfee): created successfully
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00832a9c-4831-4742-8e4c-7fa564822aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (5eb064ef-c048-4580-906f-0e4b0816ae66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:29 devstack quobyte-client[80089]: System call "getattr" of process 96006 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:29 devstack quobyte-client[80089]: System call "lookup" of process 96006 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-470bfe2c-4e25-42c6-a532-da47f2745c49 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created volume successfully.
Sep 30 15:51:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=164, name=volume-34307692-d1fd-439f-94f6-cd44dbf76067, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:29 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (c78e7960-a265-4890-9ece-6a0b6c9442ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c91d588-0d92-4562-8698-f3c0b9d7ac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067 1073741824" returned: 0 in 0.207s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c91d588-0d92-4562-8698-f3c0b9d7ac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-917434193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bb0997-4986-4919-9e83-3ef631cc0bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:30Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720006a9-1756-4a2a-918d-cd537e163b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720006a9-1756-4a2a-918d-cd537e163b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb21bd3-7a24-4753-8f65-bef0318edbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb21bd3-7a24-4753-8f65-bef0318edbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1bb0997-4986-4919-9e83-3ef631cc0bf4', 'volume_name': 'volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c5ef21-ad7a-4cd6-bf17-3ef83a02f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c5ef21-ad7a-4cd6-bf17-3ef83a02f51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e0b123-c5fb-4bf1-b6e0-a1a83175d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume d1bb0997-4986-4919-9e83-3ef631cc0bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4', 'volume_size': 1}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067" returned: 0 in 0.099s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] <== create_volume: return (314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.318s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-917434193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bb0997-4986-4919-9e83-3ef631cc0bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3f0eebde4843d4b692086b069a1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:30Z,use_quota=True,user_id='0e63a1e3b1544b939e47ca9a814e82a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Creating volume d1bb0997-4986-4919-9e83-3ef631cc0bf4 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52861281-f7fa-481a-968a-02318ffa85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34307692-d1fd-439f-94f6-cd44dbf76067', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd71fe-3a34-4fc7-8afb-37d04776ddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume volume-34307692-d1fd-439f-94f6-cd44dbf76067 (34307692-d1fd-439f-94f6-cd44dbf76067): created successfully
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd71fe-3a34-4fc7-8afb-37d04776ddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:29 devstack quobyte-client[80089]: System call "create" of process 96010 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:29 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (f8bd1b8f-4c2f-4bf8-b150-c29738f5ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:29 devstack quobyte-client[80089]: System call "getattr" of process 96010 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:29 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-d1e6001b-01fa-4ba9-a4ef-cacc4899f562 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created volume successfully.
Sep 30 15:51:29 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=165, name=volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:29 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4 1073741824" returned: 0 in 0.174s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4" returned: 0 in 0.039s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] <== create_volume: return (221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.225s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e0b123-c5fb-4bf1-b6e0-a1a83175d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a678180d-bf64-4ae2-936b-9d9b5ba693be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:30 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4 (d1bb0997-4986-4919-9e83-3ef631cc0bf4): created successfully
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a678180d-bf64-4ae2-936b-9d9b5ba693be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:30 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Flow 'volume_create_manager' (c78e7960-a265-4890-9ece-6a0b6c9442ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:30 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-2ec18caf-e66d-47c4-8f5a-11e7e6d29692 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created volume successfully.
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-d1bb0997-4986-4919-9e83-3ef631cc0bf4-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-d1bb0997-4986-4919-9e83-3ef631cc0bf4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-d1bb0997-4986-4919-9e83-3ef631cc0bf4" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-d1bb0997-4986-4919-9e83-3ef631cc0bf4" acquired by "delete_volume" :: waited 0.021s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf87a37-579e-47f1-8544-5d93c25ea6d7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Flow 'volume_create_manager' (ec2189b6-0cc1-4040-966c-f77a3f6cd53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2dbac9-f166-463b-b5e6-476ffbe73a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2dbac9-f166-463b-b5e6-476ffbe73a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80bf42fdd6842e5a5117b2fea5219bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:31Z,use_quota=True,user_id='9a88cea03bd8417d80c5403d73901c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a702be34-1ba1-475c-9c87-c0d308934282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a702be34-1ba1-475c-9c87-c0d308934282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb96434b-ada3-4829-80e5-0ec7ba458a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb96434b-ada3-4829-80e5-0ec7ba458a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad', 'volume_name': 'volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078f4ecc-e34b-489b-b332-1b50d1628da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078f4ecc-e34b-489b-b332-1b50d1628da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aec03e-7b30-4b5a-a952-3ef3a5568379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Volume 2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad', 'volume_size': 1}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80bf42fdd6842e5a5117b2fea5219bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:31Z,use_quota=True,user_id='9a88cea03bd8417d80c5403d73901c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Creating volume 2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=166, name=volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4" returned: 0 in 0.170s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-d1bb0997-4986-4919-9e83-3ef631cc0bf4" returned: 0 in 0.042s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-d1bb0997-4986-4919-9e83-3ef631cc0bf4" released by "delete_volume" :: held 0.237s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['c4d36830-3e60-4cd7-b6c6-eeab07d99d1d', '2890018b-3f82-4d43-b93c-581edc577b7c', '7443b552-1d5d-440b-b942-57da384cad24', '851533f8-0628-457a-8eea-26c63d293016'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad 1073741824" returned: 0 in 0.199s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad" returned: 0 in 0.067s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] <== create_volume: return (273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.276s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aec03e-7b30-4b5a-a952-3ef3a5568379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8020bc19-8d74-4f8e-adf7-5a368368738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Flow 'volume_create_manager' (7086824a-a4d3-4973-b2f4-c5fdcb430b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec913f0-8392-4651-a2da-d416e68161ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Volume volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad (2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad): created successfully
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8020bc19-8d74-4f8e-adf7-5a368368738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Flow 'volume_create_manager' (ec2189b6-0cc1-4040-966c-f77a3f6cd53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.130s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec913f0-8392-4651-a2da-d416e68161ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1179533902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311d6bbe-f36c-4d18-b999-269e810c9aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0cc1551b0a4712a66e71835e1d1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:32Z,use_quota=True,user_id='e2e3774228d241509fdb0a744e7b8f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58b6037-689e-41b7-9125-6d410658f70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58b6037-689e-41b7-9125-6d410658f70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e700147-1aba-4004-87f2-87cd0650c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e700147-1aba-4004-87f2-87cd0650c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311d6bbe-f36c-4d18-b999-269e810c9aa8', 'volume_name': 'volume-311d6bbe-f36c-4d18-b999-269e810c9aa8', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccb8483-9209-4f0e-8442-4fa96681f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccb8483-9209-4f0e-8442-4fa96681f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cecf08-008a-4b53-aa1f-a1c18fc38a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Volume 311d6bbe-f36c-4d18-b999-269e810c9aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311d6bbe-f36c-4d18-b999-269e810c9aa8', 'volume_size': 1}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1179533902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311d6bbe-f36c-4d18-b999-269e810c9aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0cc1551b0a4712a66e71835e1d1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:32Z,use_quota=True,user_id='e2e3774228d241509fdb0a744e7b8f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Creating volume 311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleted volume successfully.
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-3f99b143-9280-4f08-8d9d-f8af47368e55 tempest-CinderUnicodeTest-1560872357 None] Created volume successfully.
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-48931082-3314-4870-9d06-4142c13e0379 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-d1bb0997-4986-4919-9e83-3ef631cc0bf4-delete_volume" released by "delete_volume" :: held 0.661s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:31 devstack quobyte-client[80089]: System call "getattr" of process 96023 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:31 devstack quobyte-client[80089]: System call "lookup" of process 96023 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:31 devstack quobyte-client[80089]: System call "create" of process 96023 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:31 devstack quobyte-client[80089]: System call "getattr" of process 96023 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:31 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=167, name=volume-311d6bbe-f36c-4d18-b999-269e810c9aa8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 1073741824" returned: 0 in 0.160s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] <== create_volume: return (190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.193s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cecf08-008a-4b53-aa1f-a1c18fc38a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311d6bbe-f36c-4d18-b999-269e810c9aa8', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28996523-63b5-490f-a717-41031bbb200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Volume volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 (311d6bbe-f36c-4d18-b999-269e810c9aa8): created successfully
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28996523-63b5-490f-a717-41031bbb200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:31 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Flow 'volume_create_manager' (7086824a-a4d3-4973-b2f4-c5fdcb430b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:31 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-f1d955c1-e13a-4bc7-a666-e0a0a96807fa tempest-SnapshotDependencyTests-907357080 None] Created volume successfully.
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-34307692-d1fd-439f-94f6-cd44dbf76067-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-34307692-d1fd-439f-94f6-cd44dbf76067-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-34307692-d1fd-439f-94f6-cd44dbf76067" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-34307692-d1fd-439f-94f6-cd44dbf76067" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df4c24-901b-4d71-94b4-9a1a69e482d0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067" returned: 0 in 0.138s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-34307692-d1fd-439f-94f6-cd44dbf76067" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-34307692-d1fd-439f-94f6-cd44dbf76067" released by "delete_volume" :: held 0.185s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['45c4146d-0f90-45e9-b993-9d84e8e058f1', '1c931dcf-e476-4f77-acef-083de28252b4', 'e23082ab-e412-4d11-be33-bd6140a07e1d', 'edfbce64-424b-4711-b467-e6acbbe8d3ec'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Flow 'volume_create_manager' (81cdba83-7bae-4d04-b5f7-5c6387ed3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf8e65b-fe06-4e32-8c72-44c1f0764c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf8e65b-fe06-4e32-8c72-44c1f0764c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1688941102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196a3c40-8a24-4018-bf7d-abdda2c91a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80bf42fdd6842e5a5117b2fea5219bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:32Z,use_quota=True,user_id='9a88cea03bd8417d80c5403d73901c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364bc0bd-009a-4806-ad04-73de8d62d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364bc0bd-009a-4806-ad04-73de8d62d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b5f7e2-76d6-481f-9726-a7124c22925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b5f7e2-76d6-481f-9726-a7124c22925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196a3c40-8a24-4018-bf7d-abdda2c91a6d', 'volume_name': 'volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04fbf94-c96b-4c96-8015-216969bd7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04fbf94-c96b-4c96-8015-216969bd7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e26b3f-68c7-40b6-bd62-0c6f0f01d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:32 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Volume 196a3c40-8a24-4018-bf7d-abdda2c91a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d', 'volume_size': 1}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4244d0190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1688941102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196a3c40-8a24-4018-bf7d-abdda2c91a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80bf42fdd6842e5a5117b2fea5219bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:32Z,use_quota=True,user_id='9a88cea03bd8417d80c5403d73901c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)}" {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Creating volume 196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:32 devstack cinder-volume[80302]: INFO cinder.volume.drivers.remotefs [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] casted to osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d 1073741824 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:32 devstack quobyte-client[80089]: System call "getattr" of process 96032 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:32 devstack quobyte-client[80089]: System call "lookup" of process 96032 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:32 devstack quobyte-client[80089]: System call "create" of process 96032 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:32 devstack quobyte-client[80089]: System call "getattr" of process 96032 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.031s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:32 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=168, name=volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:32 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleted volume successfully.
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0f36450e-67ec-48a3-a570-852ca7d50232 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-34307692-d1fd-439f-94f6-cd44dbf76067-delete_volume" released by "delete_volume" :: held 0.444s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d 1073741824" returned: 0 in 0.148s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] <== create_volume: return (181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'} {{(pid=80302) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.183s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e26b3f-68c7-40b6-bd62-0c6f0f01d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d', 'volume_size': 1}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e8666-4094-437c-b18c-86b2b47ca8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:32 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Volume volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d (196a3c40-8a24-4018-bf7d-abdda2c91a6d): created successfully
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e8666-4094-437c-b18c-86b2b47ca8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Flow 'volume_create_manager' (81cdba83-7bae-4d04-b5f7-5c6387ed3255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:32 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-a0072c40-0c77-40f5-9360-e8b5c16f6396 tempest-CinderUnicodeTest-1560872357 None] Created volume successfully.
Sep 30 15:51:32 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Creating offline snapshot c7c66ac9-1332-46dd-ab12-ef63d15164d4 of volume 311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac848e-26aa-407f-b79f-50802e420316]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.135s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:32 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=169, name=volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 1G" returned: 0 in 0.095s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): qemu-img rebase -u -b volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "qemu-img rebase -u -b volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.035s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.022s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.info" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.info" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.389s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-7fa7337e-d1d5-4137-ace0-2fc891e7976c tempest-SnapshotDependencyTests-907357080 None] Create snapshot completed successfully
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-0efa033e-f885-469c-a88d-fbb3b6edbfee-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-0efa033e-f885-469c-a88d-fbb3b6edbfee-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:33 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-0efa033e-f885-469c-a88d-fbb3b6edbfee" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-0efa033e-f885-469c-a88d-fbb3b6edbfee" acquired by "delete_volume" :: waited 0.014s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a57b643-07a9-4e01-95e7-88aa90acceb2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee" returned: 0 in 0.152s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-0efa033e-f885-469c-a88d-fbb3b6edbfee" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-0efa033e-f885-469c-a88d-fbb3b6edbfee" released by "delete_volume" :: held 0.194s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['eb6d35f5-4089-4eb4-b3cb-1a6cde3bafd3', '5253cbbd-9385-4e42-8cc8-ae91cb7cdcb7', '7c79a07c-306e-42d4-9efd-5d516cb3edb6', '3c725031-154e-4dc1-afe5-aef9735a230b'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.029s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:33 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleted volume successfully.
Sep 30 15:51:33 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Creating offline snapshot 479daee0-4f62-44ae-b62a-278d0a86c42c of volume 196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0bb9a982-6917-407e-97ba-9b4bda924d48 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-0efa033e-f885-469c-a88d-fbb3b6edbfee-delete_volume" released by "delete_volume" :: held 0.387s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f60bc7b-628a-431a-948b-5576cadccf46]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d" returned: 0 in 0.145s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c 1G {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:33 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=171, name=volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c 1G" returned: 0 in 0.103s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:33 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): qemu-img rebase -u -b volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "qemu-img rebase -u -b volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d -F qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c" returned: 0 in 0.034s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Setting permissions: /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d -> 1000:1000 {{(pid=80302) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.info" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.info is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.info {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.info" returned: 0 in 0.016s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.397s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-03bb5cd2-5e56-48f6-9f11-c314ad271189 tempest-CinderUnicodeTest-1560872357 None] Create snapshot completed successfully
Sep 30 15:51:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.flows.manager.create_volume [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80302) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Flow 'volume_create_manager' (a8c4bda4-e940-43f7-b058-9f772d74c270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c96d16a-0ab8-448e-a03e-8c3f1985e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c96d16a-0ab8-448e-a03e-8c3f1985e814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T13:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616f4252-2918-45df-ad48-5e0d38b32601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0cc1551b0a4712a66e71835e1d1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T13:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7c66ac9-1332-46dd-ab12-ef63d15164d4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T13:51:34Z,use_quota=True,user_id='e2e3774228d241509fdb0a744e7b8f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffc6c8c-de10-432a-81ea-fd1a47ef0078),volume_type_id=4ffc6c8c-de10-432a-81ea-fd1a47ef0078)' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4534166-4a23-40bb-95c5-60f28c73b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4534166-4a23-40bb-95c5-60f28c73b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f0ef58-bc6b-4047-a473-308da088c20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f0ef58-bc6b-4047-a473-308da088c20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '616f4252-2918-45df-ad48-5e0d38b32601', 'volume_name': 'volume-616f4252-2918-45df-ad48-5e0d38b32601', 'volume_size': 1, 'snapshot_id': 'c7c66ac9-1332-46dd-ab12-ef63d15164d4'}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19100ac7-52b4-4d01-a2de-638cfc3036e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19100ac7-52b4-4d01-a2de-638cfc3036e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a799591-4c67-41df-b181-914632e4e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:34 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Volume 616f4252-2918-45df-ad48-5e0d38b32601: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-616f4252-2918-45df-ad48-5e0d38b32601', 'volume_size': 1, 'snapshot_id': 'c7c66ac9-1332-46dd-ab12-ef63d15164d4'}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-quobyte-c7c66ac9-1332-46dd-ab12-ef63d15164d4-616f4252-2918-45df-ad48-5e0d38b32601" by "_create_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-c7c66ac9-1332-46dd-ab12-ef63d15164d4-616f4252-2918-45df-ad48-5e0d38b32601" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Creating volume 616f4252-2918-45df-ad48-5e0d38b32601 from snapshot c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:360}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Selected osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718 as target Quobyte volume. {{(pid=80302) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:689}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-quobyte-616f4252-2918-45df-ad48-5e0d38b32601" by "_copy_volume_from_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-616f4252-2918-45df-ad48-5e0d38b32601" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] snapshot: c7c66ac9-1332-46dd-ab12-ef63d15164d4, volume: 616f4252-2918-45df-ad48-5e0d38b32601,  {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569ca06-806d-4a51-b359-9c475e1653af]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-4ab66649-f33f-4a1c-a578-547e94c1d27b-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-4ab66649-f33f-4a1c-a578-547e94c1d27b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-4ab66649-f33f-4a1c-a578-547e94c1d27b" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-4ab66649-f33f-4a1c-a578-547e94c1d27b" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack quobyte-client[80089]: System call "getattr" of process 96068 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc22430-6052-4ed8-b006-743706dfb8b2]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-311d6bbe-f36c-4d18-b999-269e810c9aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:424}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Creating direct copy from snapshot {{(pid=80302) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:432}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76c00f-d853-45fb-a0b5-88696a9713c1]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b" returned: 0 in 0.139s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-4ab66649-f33f-4a1c-a578-547e94c1d27b" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.149s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.utils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 not found in is_blk_device check {{(pid=80302) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-4ab66649-f33f-4a1c-a578-547e94c1d27b" released by "delete_volume" :: held 0.191s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['239b9751-34d4-45ee-b382-ffde24f74cac', '3ff0c224-c531-4dd7-8db7-38a57c264404', '8e6bfd40-4c9d-4875-b55c-630b37d2e523', 'f686deb5-c24d-47d1-b396-1ae6f97e8e01'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:34 devstack quobyte-client[80089]: The server volume:6805ea78-c5bd-4ca1-bc25-61de153ac01d@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6805ea78-c5bd-4ca1-bc25-61de153ac01d, inode=173, name=volume-616f4252-2918-45df-ad48-5e0d38b32601, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.100), requestorAccessMask=0
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:34 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleted volume successfully.
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-479daee0-4f62-44ae-b62a-278d0a86c42c-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-479daee0-4f62-44ae-b62a-278d0a86c42c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-quobyte-196a3c40-8a24-4018-bf7d-abdda2c91a6d" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-bde35d9f-1681-40ca-b0f2-7fb8b279481e tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-4ab66649-f33f-4a1c-a578-547e94c1d27b-delete_volume" released by "delete_volume" :: held 0.385s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-196a3c40-8a24-4018-bf7d-abdda2c91a6d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-quobyte-479daee0-4f62-44ae-b62a-278d0a86c42c" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-479daee0-4f62-44ae-b62a-278d0a86c42c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Deleting offline snapshot 479daee0-4f62-44ae-b62a-278d0a86c42c of volume 196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] snapshot_file for this snap is: volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[db693f7f-c974-4195-9b14-7a56b0a990d6]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:34 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "lookup" of process 96089 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "getattr" of process 96089 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "open" of process 96089 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c" returned: 0 in 0.397s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66ebbd-b631-47b0-9a4c-79b8fd3aa5a7]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "getattr" of process 96092 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d" returned: 0 in 0.280s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "getattr" of process 96095 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "lookup" of process 96095 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "getattr" of process 96095 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack quobyte-client[80089]: System call "open" of process 96095 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-29cadb80-91b9-4b89-8a03-e336668eb8a1-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-29cadb80-91b9-4b89-8a03-e336668eb8a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c" returned: 0 in 0.214s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:35 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-29cadb80-91b9-4b89-8a03-e336668eb8a1" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d.479daee0-4f62-44ae-b62a-278d0a86c42c" returned: 0 in 0.049s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-479daee0-4f62-44ae-b62a-278d0a86c42c" released by "_delete_snapshot" :: held 1.058s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-29cadb80-91b9-4b89-8a03-e336668eb8a1" acquired by "delete_volume" :: waited 0.074s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-196a3c40-8a24-4018-bf7d-abdda2c91a6d" released by "delete_snapshot" :: held 1.128s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f17ac9-8f64-4225-ba6d-ebfb9df5cdcb]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:35 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Created reservations ['e802e0f4-81b1-4b64-b583-9c135131c0e2', '7d55e22d-2a68-425b-8725-87852dc29709', '9c28ce1f-d9d3-411b-9903-68edb2fa604b', '382d5504-3848-4061-bc79-623b91ec8daa'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Delete snapshot completed successfully.
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-553396b0-d791-495f-9447-c29358f356ff tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-479daee0-4f62-44ae-b62a-278d0a86c42c-delete_snapshot" released by "delete_snapshot" :: held 1.317s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601" returned: 0 in 1.659s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c5f71e-1b50-4b75-b3d8-92599231ad7a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:36 devstack quobyte-client[80089]: System call "getattr" of process 96099 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:36 devstack quobyte-client[80089]: System call "open" of process 96099 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1" returned: 0 in 0.395s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-29cadb80-91b9-4b89-8a03-e336668eb8a1" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-29cadb80-91b9-4b89-8a03-e336668eb8a1" released by "delete_volume" :: held 0.479s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['3c2409e2-0550-49bd-933d-c84c460135e8', 'a8ddb771-ca26-4174-9971-299efb4c6722', '24a44b0b-928a-4bb9-9458-527398f81ff7', 'c01cd7e0-ce21-4bd8-a6ac-8761db52aaf1'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleted volume successfully.
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-db2932fb-0c62-4fe4-badb-d30fbcbb715a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-29cadb80-91b9-4b89-8a03-e336668eb8a1-delete_volume" released by "delete_volume" :: held 0.761s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.300s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.image.image_utils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Image conversion details: src /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8, size 1024.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 {{(pid=80302) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 15:51:36 devstack cinder-volume[80302]: INFO cinder.image.image_utils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Converted 1024.00 MB image at 616.99 MB/s
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] File path /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 is being set with permissions: 660 {{(pid=80302) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-616f4252-2918-45df-ad48-5e0d38b32601" released by "_copy_volume_from_snapshot" :: held 2.347s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-c7c66ac9-1332-46dd-ab12-ef63d15164d4-616f4252-2918-45df-ad48-5e0d38b32601" released by "_create_volume_from_snapshot" :: held 2.362s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.369s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a799591-4c67-41df-b181-914632e4e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616f4252-2918-45df-ad48-5e0d38b32601', 'volume_size': 1, 'snapshot_id': 'c7c66ac9-1332-46dd-ab12-ef63d15164d4'}' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504228b0-2c7f-40dd-bbd7-78009b384610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 15:51:36 devstack cinder-volume[80302]: INFO cinder.volume.flows.manager.create_volume [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Volume volume-616f4252-2918-45df-ad48-5e0d38b32601 (616f4252-2918-45df-ad48-5e0d38b32601): created successfully
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504228b0-2c7f-40dd-bbd7-78009b384610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80302) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Flow 'volume_create_manager' (a8c4bda4-e940-43f7-b058-9f772d74c270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80302) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 15:51:36 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-86aa7c57-070a-403c-8d81-d3192b0335f9 tempest-SnapshotDependencyTests-907357080 None] Created volume successfully.
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-12c230dc-adc9-4387-b798-e80b4433f016-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-12c230dc-adc9-4387-b798-e80b4433f016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:36 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-69e1fa0c-cc13-43e8-b249-36e53d56d093" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-69e1fa0c-cc13-43e8-b249-36e53d56d093" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-12c230dc-adc9-4387-b798-e80b4433f016" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-12c230dc-adc9-4387-b798-e80b4433f016" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleting offline snapshot 12c230dc-adc9-4387-b798-e80b4433f016 of volume 69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] snapshot_file for this snap is: volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-196a3c40-8a24-4018-bf7d-abdda2c91a6d-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6ed9e-3c7e-4ce2-859f-d8cba546cc8f]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:36 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-196a3c40-8a24-4018-bf7d-abdda2c91a6d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-quobyte-196a3c40-8a24-4018-bf7d-abdda2c91a6d" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-196a3c40-8a24-4018-bf7d-abdda2c91a6d" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf45e15b-514a-401b-a0bf-0ab1b35442bc]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016" returned: 0 in 0.149s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e1fa0c-cc13-43e8-b249-36e53d56d093(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b402252-1b10-4c16-b9a0-45f2a598d2ca]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack quobyte-client[80089]: System call "getattr" of process 96109 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-196a3c40-8a24-4018-bf7d-abdda2c91a6d" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-196a3c40-8a24-4018-bf7d-abdda2c91a6d" released by "delete_volume" :: held 0.211s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Created reservations ['a86ec29c-b551-42a9-9d9d-3cf89fb154db', 'ea081a7c-dd21-408e-9fb0-41cfe19c1763', '94c1ac1c-bc12-46a8-a553-0713f69ea9b3', '6021b744-eee8-4ec0-948a-f6cd4f3d5e97'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093" returned: 0 in 0.178s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.021s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:37 devstack quobyte-client[80089]: System call "getattr" of process 96118 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Deleted volume successfully.
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-0c9e2669-29cb-45b7-8298-baaba8f14d56 tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-196a3c40-8a24-4018-bf7d-abdda2c91a6d-delete_volume" released by "delete_volume" :: held 0.399s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016" returned: 0 in 0.078s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093.12c230dc-adc9-4387-b798-e80b4433f016" returned: 0 in 0.032s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-12c230dc-adc9-4387-b798-e80b4433f016" released by "_delete_snapshot" :: held 0.500s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-69e1fa0c-cc13-43e8-b249-36e53d56d093" released by "delete_snapshot" :: held 0.513s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['7329c06f-3476-451a-9af1-e025ea617b0e', 'd6fd4abb-1ec2-4b21-95dc-dec9fdce7ad8', '24e2b9ea-6ba6-4fa6-953b-c812977f487d', '78aaaee6-7851-497a-b425-d459b5bd9cd2'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-c7c66ac9-1332-46dd-ab12-ef63d15164d4-delete_snapshot" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-c7c66ac9-1332-46dd-ab12-ef63d15164d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:37 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-quobyte-311d6bbe-f36c-4d18-b999-269e810c9aa8" by "delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:37 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Delete snapshot completed successfully.
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-b12f1c89-4bca-4adc-b58b-79b91e0b083a tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-12c230dc-adc9-4387-b798-e80b4433f016-delete_snapshot" released by "delete_snapshot" :: held 0.608s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-311d6bbe-f36c-4d18-b999-269e810c9aa8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-quobyte-c7c66ac9-1332-46dd-ab12-ef63d15164d4" by "_delete_snapshot" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-c7c66ac9-1332-46dd-ab12-ef63d15164d4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Deleting offline snapshot c7c66ac9-1332-46dd-ab12-ef63d15164d4 of volume 311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] snapshot_file for this snap is: volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92d21ee-edde-40e9-b45b-5adbbf0a3184]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.131s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.remotefs [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-311d6bbe-f36c-4d18-b999-269e810c9aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80302) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aaa4c9-b7a9-413b-b777-52bc91e0b926]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.132s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack quobyte-client[80089]: System call "lookup" of process 96129 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:37 devstack quobyte-client[80089]: System call "getattr" of process 96129 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:37 devstack quobyte-client[80089]: System call "open" of process 96129 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.070s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8.c7c66ac9-1332-46dd-ab12-ef63d15164d4" returned: 0 in 0.024s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-c7c66ac9-1332-46dd-ab12-ef63d15164d4" released by "_delete_snapshot" :: held 0.407s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-311d6bbe-f36c-4d18-b999-269e810c9aa8" released by "delete_snapshot" :: held 0.421s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-69e1fa0c-cc13-43e8-b249-36e53d56d093-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Created reservations ['805a03c9-3c6c-4552-94d0-ae65fcac8562', '39a34212-fa8c-4c7f-ae37-4f432bcc3596', '0dcfa146-af24-4cc3-b47e-da0a4bc25e2f', '77c2b6ae-f2f7-469e-9d96-7e54b3d6ba84'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:37 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-69e1fa0c-cc13-43e8-b249-36e53d56d093-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "cinder-quobyte-69e1fa0c-cc13-43e8-b249-36e53d56d093" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Delete snapshot completed successfully.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-69e1fa0c-cc13-43e8-b249-36e53d56d093" acquired by "delete_volume" :: waited 0.028s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-eb862efd-9851-4e50-bf31-8a32ec85474f tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-c7c66ac9-1332-46dd-ab12-ef63d15164d4-delete_snapshot" released by "delete_snapshot" :: held 0.564s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[beab0f55-1484-445e-8df9-a870c7c5a3f4]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "cinder-quobyte-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad" acquired by "delete_volume" :: waited 0.007s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[243b0a41-b319-4c01-a131-70ff4607805a]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093" returned: 0 in 0.161s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-69e1fa0c-cc13-43e8-b249-36e53d56d093" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-quobyte-69e1fa0c-cc13-43e8-b249-36e53d56d093" released by "delete_volume" :: held 0.218s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Created reservations ['8b8dc5ce-4951-47ac-93f4-3fe23ca524fe', 'dcc7f0b9-b5ab-45b6-851b-7e07864844f1', 'bff1ddd2-91bd-459e-a447-a262b8400787', '9702190d-4f04-48ef-9c6f-6837060ffcd5'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad" returned: 0 in 0.155s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad" returned: 0 in 0.025s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-quobyte-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad" released by "delete_volume" :: held 0.202s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.023s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Deleted volume successfully.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-acf2b28b-5f66-41c4-a7a7-c8e018168948 tempest-CreateVolumesFromSnapshotTest-152286275 None] Lock "cinder-69e1fa0c-cc13-43e8-b249-36e53d56d093-delete_volume" released by "delete_volume" :: held 0.399s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Created reservations ['c023ca18-52b0-4be2-82a1-8b03bac1279a', 'ca01d4f3-edb7-4f78-9b09-756dd1acfe07', '54814f3c-4524-4be3-a482-bb2b9aa4a367', '28f6fad9-06c5-487b-bbd6-07b627fc9589'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Deleted volume successfully.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-ea99f1f7-e9b2-4761-b229-d9a00c38b9bd tempest-CinderUnicodeTest-1560872357 None] Lock "cinder-2d8b40ef-d59b-4d37-8e3a-69bcf0ebe2ad-delete_volume" released by "delete_volume" :: held 0.384s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-311d6bbe-f36c-4d18-b999-269e810c9aa8-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-311d6bbe-f36c-4d18-b999-269e810c9aa8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:38 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-quobyte-311d6bbe-f36c-4d18-b999-269e810c9aa8" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-311d6bbe-f36c-4d18-b999-269e810c9aa8" acquired by "delete_volume" :: waited 0.010s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2d0ec1-a02a-4eab-ac76-35553ae7c2b0]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.133s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-311d6bbe-f36c-4d18-b999-269e810c9aa8" returned: 0 in 0.018s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-311d6bbe-f36c-4d18-b999-269e810c9aa8" released by "delete_volume" :: held 0.185s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Created reservations ['6e5a4cb1-7671-44ca-af8a-f305569437f4', 'bc8329c5-c9cd-44fd-8c7a-30d4c428b758', 'b9dec1e9-ad03-416f-bde0-12aa28eee4f1', '4892749c-f8d6-497a-908b-1f47e8104def'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.019s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:38 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Deleted volume successfully.
Sep 30 15:51:38 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-4a693536-ca7c-4c29-bd21-fc0fed3d2529 tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-311d6bbe-f36c-4d18-b999-269e810c9aa8-delete_volume" released by "delete_volume" :: held 0.327s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_service.periodic_task [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80302) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.020s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9546bf4b-d347-4399-9515-f99d34f5fba2 None None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-616f4252-2918-45df-ad48-5e0d38b32601-delete_volume" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-616f4252-2918-45df-ad48-5e0d38b32601-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:39 devstack cinder-volume[80302]: WARNING cinder.volume.volume_utils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Volume driver (QuobyteDriver 1.1.15) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "cinder-quobyte-616f4252-2918-45df-ad48-5e0d38b32601" by "delete_volume" {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-616f4252-2918-45df-ad48-5e0d38b32601" acquired by "delete_volume" :: waited 0.008s {{(pid=80302) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79b36b-4c64-4caa-b8b1-b42538b67ce3]: (4, 'qcow2') {{(pid=81092) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601" returned: 0 in 0.163s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:39 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] CMD "rm -f /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152/volume-616f4252-2918-45df-ad48-5e0d38b32601" returned: 0 in 0.037s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-quobyte-616f4252-2918-45df-ad48-5e0d38b32601" released by "delete_volume" :: held 0.244s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG cinder.quota [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Created reservations ['8d3719e5-8fb8-4ce8-a743-43832765164e', '3b622044-2eed-4417-8270-fb9d863c2487', 'c659772e-6a4d-480a-8449-5ac76ccebe5b', 'd6b4d346-75b0-4e00-aec5-ade3246b4ce8'] {{(pid=80302) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718': None} {{(pid=80302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:638}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3cf712b-3f66-4b4c-942f-f91d04acb718'] {{(pid=80302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.lockutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80302) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152 {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG oslo_concurrency.processutils [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/b42291ebce04d1876ea28cceda241152" returned: 0 in 0.042s {{(pid=80302) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG cinder.manager [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Notifying Schedulers of capabilities ... {{(pid=80302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 15:51:40 devstack cinder-volume[80302]: INFO cinder.volume.manager [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Deleted volume successfully.
Sep 30 15:51:40 devstack cinder-volume[80302]: DEBUG cinder.coordination [None req-9b9e0280-887d-4e1e-a5f9-10e5f655b8dc tempest-SnapshotDependencyTests-907357080 None] Lock "cinder-616f4252-2918-45df-ad48-5e0d38b32601-delete_volume" released by "delete_volume" :: held 0.460s {{(pid=80302) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 15:51:44 devstack quobyte-client[80089]: Unable to open /proc/81093/environ
Sep 30 15:51:50 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:SELECT=164,cinder:UPDATE=245,cinder:DELETE=23,cinder:INSERT=64 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:51:50 devstack cinder-volume[80302]: DEBUG dbcounter [-] [80302] Writing DB stats cinder:UPDATE=237,cinder:SELECT=150,cinder:DELETE=24,cinder:INSERT=45 {{(pid=80302) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 15:51:52 devstack quobyte-client[80089]: Unable to open /proc/81093/environ